Senior Solution Architect2019 - PRESENTPillar Base, Inc.
Technologies: Serverless, AWS Lambda, DynamoDB, Cognito, Spark SQL, TypeScript, BigCommerce API
- Developed an application to denormalize data from the relational database and stream it to an AWS Dynamo DB single table.
- Worked on a proof of concept (POC) to assess the performance between Apache Spark SQL, Presto DB, and Apache Drill, with parquet files.
- Built a data warehouse on AWS using Redshift and Redshift Spectrum.
Senior Scala Developer2019 - 2020ReactiveCore
Technologies: Scala, Akka, Golang, AWS EKS, AWS Glue, Kafka, Spark, Kubernetes, Istio, Node.js, React, AWS Kinesis
- Architected and developed a solution to implement a worker thread pattern integrated with Apache Kafka.
- Rearchitected the microservices components to implement the service mesh (Istio) in Kubernetes over the AWS EKS cluster.
- Built a real-time streaming solution on AWS using Kinesis and AWS Glue. Developed a data model.
- Implemented Apache Spark streaming with Apache Kafka to support the data model.
- Integrated Apache Druid with Apache Kafka to implement time-series analytics on the AWS EKS cluster.
Senior Data Engineer2019 - 2019BCG GAMMA
Technologies: Python, Apache Airflow, Docker, CircleCI, Docker Compose
- Developed and optimized the Apache Airflow graph solution to support the data model.
- Packaged the solution using Docker and Docker Compose.
- Built a workflow in CircleCI to automate the building, packaging, and deploying processes.
- Developed a big data ETL solution on Azure Cloud, based on DataFactory and integrated with Data Lake Analytics.
Senior Solution Architect2019 - 2019CN Railway
Technologies: Java, Scala, Python, AWS EMR/EKS/Kinese, Apache Kafka, Apache Spark, React, Node.js, Kubernetes
- Built real-time and batch processing ETL solutions based on the DataFactory.
- Architected and developed an event-driven application using Node.js, React, and GraphQL using Serverless tech.
- Architect and build an integration solution using Apache Kafka on the AWS EKS cluster with Azure Power BI.
- Designed a solution based on React and Node.js and deployed the solution using Docker and Kubernetes.
- Architect and develop a solution to stream the data into the data warehouse on Azure.
- Engineered interactive dashboards using Power BI with a data warehouse.
Big Data Architect2016 - 2019Morgan Stanley
Technologies: Scala, Java, Golang, Python, Node.js, AWS Kinesis, React, NLP, DL, ML, AWS EMR
- Architected and developed a big data ETL solution based on AWS EMR and AWS Kinesis.
- Worked on building a knowledge graph using a triple store database and Elasticsearch.
- Created a data streaming solution using S3, Lambda functions, AWS Kinesis data streaming, and AWS EMR service.
- Helped on developing an NLP solution to enhance/enrich the features in the market data reports as a data analyst.
- Built a data interactive UI based on React and React D3 integrated with Azure Power BI.
- Developed a search engine for market data integrated with Elasticsearch and Apache Solr.
- Worked on a POC to compare the latency between C++ and Golang.
Big Data Developer2016 - 2016TD Bank
Technologies: Java, Scala, Golang, Hadoop, Spark, Streaming
- Developed a solution to three ETL big data projects using Apache Hive and Oozie.
- Worked as part of the team on extending Hadoop security functionality.
- Architected and developed a multi-threaded Java application to integrate a Linux local account with the Active directory, business requirement analysis, and sketching technical solution.
- Received “Act for Impact Award” on my work.
Lead Software Engineer2014 - 2015NetBridge Consulting
Technologies: Apache Spark, Scala, Kafka, Apache Cassandra, Java 8
- Architected and developed two big data ETL applications based on Apache Spark, AKKA, Kafka, and Cassandra.
- Built an application based on test-driven development (TDD).
Senior Software Engineer2011 - 2014Lebanon Consultant
Technologies: Big Data, Scala, AKKA, Java
- Built and introduced big data practices.
- Architected and built an ERP solution.
- Spearheaded an integration solution.
Senior Solution Architect2005 - 2011Accad Institute
Technologies: Java, Oracle, WebLogic
- Gathered the software developers' team.
- Architected and developed the institute management solution.
- Built a solution to automate the sugar factory.
- Created a solution for a utility company.