Senior Data Engineer2019 - 2019BCG GAMMA
Technologies: Python, Apache Airflow, Docker, CircleCI, Docker Compose
- Developed and optimized the Apache Airflow working graph solution.
- Packaged the solution using Docker and Docker Compose.
- Built workflow in CircleCI to automate the building, packaging, and deploying process.
- Developed test scenario to cover the important use cases.
- Used Azure cloud storage tech, like Blob store, SQLDQ.
Senior Solution Architect2019 - 2019CN Railway
Technologies: Java, Scala, Python, Big Data, Apache Spark
- Delivered ETL/streaming based on Hadoop, Spark, and Flink.
- Architected and developed an event-driven application.
- Architected and developed an integration solution.
Big Data Architect2016 - 2019Morgan Stanley
Technologies: Scala, Java, Python, NLP, DL, ML, Big Data
- Architected and developed a big data ETL solution.
- Worked on building a knowledge Graph using a triple store database.
- Developed a sentiment analysis model using DL.
- Architected and developed NLP Solutions.
Big Data Developer2016 - 2016TD Bank
Technologies: Java, Scala, Hadoop/Spark, Streaming,..
- Developed a solution to three ETL big data projects using Apache Hive and Oozie.
- Worked as part of the team on extending Hadoop security functionality.
- Architected and developed a multi-threaded Java application to integrate a Linux local account with the Active directory, business requirement analysis, and sketching technical solution.
- Received “Act for Impact Award” on my work.
Lead Software Engineer2014 - 2015NetBridge Consulting
Technologies: Apache Spark, Scala, Kafka, Apache Cassandra, Java 8
- Architected and developed two big data ETL application based on Apache Spark, AKKA, Kafka, and Cassandra.
- Architected and developed an application based on TDD.
Sr. Software Engineer2011 - 2014Lebanon Consultent
Technologies: Big Data, Scala, AKKA, Java
- Built and introduced the big data practice.
- Architected and built an ERP solution.
- Architected an integration solution.
Sr. Solution Architect2005 - 2011Accad Institute
Technologies: Java, Oracle, Weblogic
- Built the software developers team.
- Architected and developed the institute management solution.
- Architected and developed a solution to automate sugar factory.
- Architected and developed a solution for a utilities company.