Senior Scala Developer2019 - 2020ReactiveCore
Technologies: Scala, Akka, Golang, AWS EKS, AWS Glue, Kafka, Spark, Kubernetes, Istio, NodeJs, React, AWS Kinesis
- Architected and developed a solution to implement worker thread pattern integrated with Apache Kafka.
- Rearchitected the microservices components to implement the service mesh (Istio) in Kubernetes over AWS EKS cluster, and build new microservices using Golang.
- Architected a realtime streaming solution on AWS using Kinesis and AWS glue, develop a data model.
- Implemented Apache Spark streaming with Apache Kafka, features enriching to support data model.
- Integrated Apache Druid with Apache Kafka to implement time-series analytics on the AWS EKS cluster and Elasticsearch.
- Worked on low latency data streaming and processing with C++.
Senior Data Engineer2019 - 2019BCG GAMMA
Technologies: Python, Apache Airflow, Docker, CircleCI, Docker Compose
- Developed and optimize the Apache Airflow graph solution, to support the data model.
- Packaged the solution using Docker and Docker Compose.
- Built workflow in CircleCI to automate the building, packaging, and deploying process.
- Developed test scenarios to cover the important use cases.
Senior Solution Architect2019 - 2019CN Railway
Technologies: Java, Scala, Python, AWS EMR, AWS EKS, Apache Kafka, Apache Spark, React, Node.js, Docker, Kubernetes, AWS Kinesis
- Built ETL(realtime and batch processing) solutions based on the AWS EMR cluster and apache Kafka integrated with ELK Stack.
- Architected and developed an event-driven application using Nodejs, React, and GraphQL with AWS Kinesis.
- Architected and developed an integration solution using apache Kafka on the AWS EKS cluster with Azure Power BI.
- Architected and developed a solution based on React and Node.js and deployed the solution using Docker and Kubernetes.
- Architect and build a solution to integrate AWS Lambda(NodeJS) with AWS Kinesis, to update a dashboard in a realtime fashion.
Big Data Architect2016 - 2019Morgan Stanley
Technologies: Scala, Java, Golang, Python, NodeJs, AWS Kinesis, React,NLP, DL, ML, AWS EMR
- Architected and developed a big data ETL solution based on AWS EMR and AWS Kinesis.
- Worked on building a knowledge Graph using a triple store database, and Elasticsearch.
- Architect and develop a data streaming solution using S3, Lambda functions, AWS Kinesis data streaming and AWS EMR service.
- As a Data analyst, worked on developing NLP solution to enhance/enrich the features in the market data reports.
- Built data interactive UI based on React and React D3 integrated with Azure power BI.
- Developed search engine for market data, integrated with Elasticsearch and apache Solr.
- Worded on a POC to compere the latency between C++ and Golang.
Big Data Developer2016 - 2016TD Bank
Technologies: Java, Scala, Golang, Hadoop, Spark, Streaming
- Developed a solution to three ETL big data projects using Apache Hive and Oozie.
- Worked as part of the team on extending Hadoop security functionality.
- Architected and developed a multi-threaded Java application to integrate a Linux local account with the Active directory, business requirement analysis, and sketching technical solution.
- Received “Act for Impact Award” on my work.
- Worded on a solution to analysis hadoop worker machine using golang.
Lead Software Engineer2014 - 2015NetBridge Consulting
Technologies: Apache Spark, Scala, Kafka, Apache Cassandra, Java 8
- Architected and developed two big data ETL application based on Apache Spark, AKKA, Kafka, and Cassandra.
- Architected and developed an application based on TDD.
Senior Software Engineer2011 - 2014Lebanon Consultent
Technologies: Big Data, Scala, AKKA, Java
- Built and introduced the big data practice.
- Architected and built an ERP solution.
- Architected an integration solution.
Senior Solution Architect2005 - 2011Accad Institute
Technologies: Java, Oracle, Weblogic
- Built the software developers team.
- Architected and developed the institute management solution.
- Architected and developed a solution to automate sugar factory.
- Architected and developed a solution for a utilities company.