Senior eCommerce Integration Engineer
2020 - PRESENTDeliverr- Worked on a Serverless project developing a REST API to integrate with a different store management API.
- Developed REST services to integrate with BigCommerce, Google Shopping, and Facebook Commerce.
- Used OAuth 2.0 and OIDC protocols to protect the API and to manage the authentication and authorization with another eCommerce API.
Technologies: Serverless, AWS Lambda, Google Shopping, Facebook API, BigCommerce API, Koa, TypeScript, Node.jsSenior Solution Architect
2019 - PRESENTPillar Base, Inc.- Developed an application to denormalize data from the relational database and stream it to an AWS Dynamo DB single table.
- Worked on a proof of concept (POC) to assess the performance between Apache Spark SQL, Presto DB, and Apache Drill, with parquet files.
- Built a data warehouse on AWS using Redshift and Redshift Spectrum.
- Architected and developed an integration solution solutions based on AWS Lambda, API Gateway, Cognito, WMS, Facebook Graph API, Google Ads API, BigCommerce, Dynamo DB, and JavaScript/TypeScript.
Technologies: Open API, BigCommerce API, TypeScript, Spark SQL, Amazon Cognito, AWS DynamoDB, AWS Lambda, ServerlessSenior Scala Developer
2019 - 2020ReactiveCore- Architected and developed a solution to implement a worker thread pattern integrated with Apache Kafka.
- Rearchitected the microservices components to implement the service mesh (Istio) in Kubernetes over the AWS EKS cluster.
- Built a real-time streaming solution on AWS using Kinesis and AWS Glue. Developed a data model.
- Implemented Apache Spark streaming with Apache Kafka to support the data model.
- Integrated Apache Druid with Apache Kafka to implement time-series analytics on the AWS EKS cluster.
Technologies: Amazon EKS, AWS Kinesis, React, Node.js, Istio, Kubernetes, Spark, Apache Kafka, AWS Glue, Go, Akka, ScalaSenior Data Engineer
2019 - 2019BCG GAMMA- Developed and optimized the Apache Airflow graph solution to support the data model.
- Packaged the solution using Docker and Docker Compose.
- Built a workflow in CircleCI to automate the building, packaging, and deploying processes.
- Developed a big data ETL solution on Azure Cloud, based on DataFactory and integrated with Data Lake Analytics.
Technologies: Docker Compose, CircleCI, Docker, Apache Airflow, PythonSenior Solution Architect
2019 - 2019CN Railway- Built real-time and batch processing ETL solutions based on the DataFactory.
- Architected and developed an event-driven application using Node.js, React, and GraphQL using Serverless tech.
- Architect and build an integration solution using Apache Kafka on the AWS EKS cluster with Azure Power BI.
- Designed a solution based on React and Node.js and deployed the solution using Docker and Kubernetes.
- Architect and develop a solution to stream the data into the data warehouse on Azure.
- Engineered interactive dashboards using Power BI with a data warehouse.
Technologies: Kubernetes, Node.js, React, Apache Spark, Apache Kafka, AWS EMR, Python, Scala, JavaBig Data Architect
2016 - 2019Morgan Stanley- Architected and developed a big data ETL solution based on AWS EMR and AWS Kinesis.
- Worked on building a knowledge graph using a triple store database and Elasticsearch.
- Created a data streaming solution using S3, Lambda functions, AWS Kinesis data streaming, and AWS EMR service.
- Helped on developing an NLP solution to enhance/enrich the features in the market data reports as a data analyst.
- Built a data interactive UI based on React and React D3 integrated with Azure Power BI.
- Developed a search engine for market data integrated with Elasticsearch and Apache Solr.
- Worked on a POC to compare the latency between C++ and Golang.
Technologies: Deep Learning, AWS EMR, Machine Learning, Natural Language Processing (NLP), React, AWS Kinesis, Node.js, Python, Go, Java, ScalaBig Data Developer
2016 - 2016TD Bank- Developed a solution to three ETL big data projects using Apache Hive and Oozie.
- Worked as part of the team on extending Hadoop security functionality.
- Architected and developed a multi-threaded Java application to integrate a Linux local account with the Active directory, business requirement analysis, and sketching technical solution.
- Received “Act for Impact Award” on my work.
Technologies: Streaming, Spark, Hadoop, Go, Scala, JavaLead Software Engineer
2014 - 2015NetBridge Consulting- Architected and developed two big data ETL applications based on Apache Spark, AKKA, Kafka, and Cassandra.
- Built an application based on test-driven development (TDD).
Technologies: Java 8, Apache Cassandra, Apache Kafka, Scala, Apache SparkSenior Software Engineer
2011 - 2014Lebanon Consultant- Built and introduced big data practices.
- Architected and built an ERP solution.
- Spearheaded an integration solution.
Technologies: Java, Akka, Scala, Big DataSenior Solution Architect
2005 - 2011Accad Institute- Gathered the software developers' team.
- Architected and developed the institute management solution.
- Built a solution to automate the sugar factory.
- Created a solution for a utility company.
Technologies: WebLogic, Oracle, Java