Moustafa is available for hire
Hire MoustafaMoustafa Abdelhamid
Verified Expert in Engineering
Software Developer
Location
Degirmendere, Körfez, Gölcük/Kocaeli, Turkey
Toptal Member Since
August 9, 2021
Moustafa is a software and data engineer with 11 years of experience designing, building, and running software systems. He has a proven track record of delivering high-quality software that is reactive and scalable. Moustafa has diverse skills beyond building software, such as infrastructure and CI/CD pipelines, ETL/ELT pipelines, and modeling. He has worked with various data technologies like Spark, Kafka, Snowflake, and BigQuery.
Portfolio
EON Energie Deutschland
Terraform, Kubernetes, Azure, Helm, Argo CD, Go, Python, GitLab CI/CD...
Transgate
Next.js, Tailwind CSS, Python, Kubernetes, GPU Computing, TypeScript, React...
Boclips
Python, Google Cloud Platform (GCP), Kotlin, Scala, Spark, BigQuery, MongoDB...
Experience
Availability
Part-time
Preferred Environment
PyCharm, IntelliJ IDEA, MacOS, WebStorm, Agile, Kubernetes, Cloud, Git, Scala, Python
The most amazing...
...thing I've done is rebuilding the data engineering team and building the data engineering platform and machine learning components.
Work Experience
MLOps Engineer
2023 - PRESENT
EON Energie Deutschland
- Deployed and configured a machine learning platform using Kubernetes on Azure (AKS), enabling ML engineers to deploy jobs and services.
- Implemented security policies, ingress gateways, and other tooling to facilitate onboarding ML projects safely and easily.
- Improved the platform's quality, stability, and reproducibility by implementing Terratests and applying the principles of GitOps and Infrastructure as Code.
Technologies: Terraform, Kubernetes, Azure, Helm, Argo CD, Go, Python, GitLab CI/CD, Multitenancy
Full-stack Developer
2023 - PRESENT
Transgate
- Developed the back-end and front-end of a speech-to-text web app using Next.js, React, and Tailwind CSS. This included implementing authentication and real-time transcription features.
- Created a scheduler for running pods with GPUs on a Google Kubernetes Engine (GKE) auto-pilot cluster.
- Developed the inference back end for running the machine learning model used for the speech-to-text task.
- Built the inference back end for executing the machine learning model utilized in the speech-to-text functionality.
Technologies: Next.js, Tailwind CSS, Python, Kubernetes, GPU Computing, TypeScript, React, Supabase, Vercel, Testing, JavaScript, SQL
Lead Data Engineer - Remote Contract
2021 - 2022
Boclips
- Worked with data scientists to develop and deploy NLP models for search and recommendation engines and labeling educational content with tools like PyTorch, Bert, and GPT-3 vectors.
- Automated the deployment of machine learning models on Kubernetes and Google Pub/Sub.
- Improved the process of building proof of concepts and integrating that into the rest of our Agile workflow.
- Maintained ETL pipelines written in Scala and Spark and migrated them to work on Kubernetes API.
- Created a new infrastructure for the data engineering team on GCP using Terraform to manage Kubernetes, Kubeflow, and Databricks Platform, networking, access control, and other cloud resources.
- Supported data science demos and experiments by developing tooling and infrastructure for authentication, security, networking, and automation to allow data scientists to focus on working on their experiments.
- Improved and maintained monitoring, alerting, and CI/CD pipeline and introduced GitOps approach with ArgoCD.
Technologies: Python, Google Cloud Platform (GCP), Kotlin, Scala, Spark, BigQuery, MongoDB, PyTorch, Kubernetes, Docker, Terraform, CI/CD Pipelines, TypeScript, Code Review, GitHub, Agile, Flask, Linux, Git, Machine Learning, Visual Studio Code (VS Code), Vim Text Editor, Data Engineering, ETL, Vector Data, OpenAI GPT-3 API, Testing, SQL, Test Automation, SaaS, Multitenancy, B2B
Senior Scala Data Engineer - Remote Contract
2020 - 2022
Streamhub
- Built ETL pipelines and designed a star schema model for a new SaaS platform.
- Supported the machine learning POC for forecasting customer segments' propensity.
- Improved airflow jobs to run jobs on Kubernetes pods.
Technologies: Scala, Spark, Apache Airflow, Snowflake, Docker, Kubernetes, CI/CD Pipelines, Amazon Web Services (AWS), Code Review, GitHub, Agile, Amazon RDS, Linux, Git, Visual Studio Code (VS Code), Vim Text Editor, PostgreSQL, Data Engineering, ETL, Testing, SQL, Test Automation, SaaS, Multitenancy, B2B
Senior Data Engineer - Remote Contract
2020 - 2022
Mobimeo
- Optimized the schema glue updater job of AWS Athena to reduce S3 usage and cost.
- Created alerts for Airflow jobs that notify the data engineering team in case of failures.
- Optimized the Kafka consumer to speed up the ETL pipeline.
Technologies: Python, Kotlin, Apache Airflow, Amazon Athena, Apache Avro, Docker, Kubernetes, Amazon Web Services (AWS), Code Review, GitHub, Agile, Linux, Git, CI/CD Pipelines, Visual Studio Code (VS Code), Vim Text Editor, Data Engineering, ETL, Testing, Test Automation
Senior Data Engineer
2018 - 2020
Risk.Ident
- Contributed to building a fraud detection system with machine learning.
- Implemented the data ingestion and machine learning services used to train, evaluate, and predict fraudulent transactions.
- Applied the data ingestion and machine learning services used for training, evaluating, and predicting fraudulent transactions.
- Built the analytics team, including data scientists, data engineers from within the company, and new hires.
Technologies: Scala, SAP Cross-Application Time Sheet (CATS), Akka, Akka Streams, Apache Kafka, Python, Scikit-learn, H20, gRPC, Kubernetes, Docker, Machine Learning, CI/CD Pipelines, Code Review, GitHub, Agile, Linux, Git, Vim Text Editor, Data Engineering, ETL, Test Automation, SaaS, Multitenancy, B2B
Senior Scala Developer
2017 - 2018
Risk.Ident
- Implemented software components of device fingerprinting services that detect suspicious devices that might be used in fraudulent activities.
- Supported and reviewed the mobile (iOS and Android) SDKs.
- Fixed performance issues related to MongoDB queries to match our SLAs.
Technologies: Scala, Akka, Apache Kafka, MongoDB, CI/CD Pipelines, Code Review, GitHub, Agile, Back-end, Linux, Git, Vim Text Editor, Test Automation, SaaS, Multitenancy, B2B
Senior Software Engineer
2014 - 2017
Cake Solutions
- Delivered projects for several clients in the UK and remotely in the US and Dubai.
- Worked on a fitness tracker where I built a system for faster experiments and collecting labels, trained different models, and developed a multi-layer perceptron in Swift that uses the iPhone GPU.
- Optimized a large Spark job to be four times faster for one of our prospective clients, which helped our company to start a more extended consultancy engagement with the new client.
Technologies: Scala, Akka, Apache Kafka, Elasticsearch, MongoDB, Spark, Cassandra, Neo4j, Keras, Theano, C, Swift, Marathon, Docker, Azure, Node.js, CI/CD Pipelines, Code Review, GitHub, Agile, Back-end, Amazon Web Services (AWS), Full-stack, Linux, Git, Vim Text Editor, Test Automation, Multitenancy
Software Engineer
2011 - 2014
Cloud9ers
- Built a single real-time page for a social network and a discussion platform. I worked on the front-end and back-end, including designing the communication protocol and resolving updates conflicts.
- Developed an online learning platform using the Django framework.
- Created virtual labs for IT courses using Linux Containers (LXC) and AWS API.
Technologies: Scala, Akka, Elasticsearch, Apache Kafka, MongoDB, Neo4j, JavaScript, Python, Redis, RabbitMQ, Ruby, Apache Thrift, Code Review, GitHub, Agile, Back-end, Amazon Web Services (AWS), Django, Celery, Linux, Git, Full-stack, Vim Text Editor
Experience
Transgate: Speech-to-text AI Tool
https://transgate.ai/enA Next.js web app for speech-to-text service. I was a full-stack developer who built the entire application with a cutting-edge tech stack that included Next.js, TypeScript, TailwindCSS, and Supabase. I helped the new startup to run the entire stack with GPU back end for transcription at a very low cost until we finished the MVP and got our first 10 happy customers.
FRIDA - Fraud Management System
https://riskident.com/en/frida/A fraud management system that detects suspicious transactions using machine learning and a rule-based engine. I worked in developing back-end services and MLOps that provide explained risk assessments of many types of transactions.
Noon Shopping
Noon is an eCommerce service based in Dubai and serves multiple Middle Eastern countries. I worked as a member of a big distributed team across three software companies to build software services for managing the company's warehouse. The main technologies I used included Scala, Play, Akka, Cassandra, CQRS, Protocol Buffers, and Mesos on AWS.
SalamWorld
A social network built in 2012 with many modern features. I designed most of the interactions to be real-time and worked on the main engine in both the back end and front end, contributing to developing the protocol and query language for real-time updates. My team built a real-time engine in Scala that uses MongoDB as a datastore back end and WebSockets for sending real-time updates to the web and mobile clients in a way similar to Firebase.
Cloud Labs
A configurable virtual lab used for IT courses. After the trainees study the materials, they can start a lab with a specific scenario to apply what they learned. The lab consists of configurable virtual machines connected to a virtual network on AWS instances.
The students can interact with those machines through the browser that connects via VNC. We implemented support for Linux-based labs to start in a couple of seconds using Linux Containers (LXC) and Butter FS. The system consists of a cloud agent that manages running AWS instances and running containers and scaling up and down, the cloud agent that starts and stops containers on each VM, and guru-mate, a small program running on each container that checks the student's progress in the lab and gives them hints to proceed.
The students can interact with those machines through the browser that connects via VNC. We implemented support for Linux-based labs to start in a couple of seconds using Linux Containers (LXC) and Butter FS. The system consists of a cloud agent that manages running AWS instances and running containers and scaling up and down, the cloud agent that starts and stops containers on each VM, and guru-mate, a small program running on each container that checks the student's progress in the lab and gives them hints to proceed.
Boclips - The World's Largest Collection of EdReady Videos
https://www.boclips.com/Built ETL pipelines and data infrastructure that supports analytics, search, machine learning, and other data science research and development. I have also developed an ML classifier using PyTorch to predict categories of educational videos.
Skills
Languages
Scala, Python, SQL, JavaScript, Swift, Kotlin, Snowflake, TypeScript, Ruby, C, Go
Libraries/APIs
Akka Streams, React, Protobuf, Keras, Theano, Node.js, Scikit-learn, PyTorch
Paradigms
ETL, Test Automation, Agile, Testing, B2B, CQRS
Platforms
Apache Kafka, Docker, Kubernetes, Google Cloud Platform (GCP), Amazon Web Services (AWS), Linux, Azure, H20, Visual Studio Code (VS Code), MacOS, Vercel
Storage
MongoDB, Elasticsearch, Neo4j, Redis, Cassandra, PostgreSQL
Other
CI/CD Pipelines, Back-end, Data Engineering, Machine Learning, Code Review, Amazon RDS, Vector Data, Front-end, SaaS, Multitenancy, SAP Cross-Application Time Sheet (CATS), LXC, WebSockets, Akka Persistence, Full-stack, Cloud, GPU Computing, OpenAI GPT-3 API, Supabase, Google Cloud Functions, IAS, Argo CD
Frameworks
Akka, Spark, Next.js, Flask, Django, Apache Thrift, Marathon, gRPC, NestJS, Angular, Ruby on Rails (RoR), Play 2, Tailwind CSS, Spring Boot
Tools
BigQuery, Terraform, GitHub, Git, RabbitMQ, PyCharm, IntelliJ IDEA, Vim Text Editor, Xcode, Apache Airflow, Amazon Athena, Apache Avro, Mesos, Celery, WebStorm, Google Kubernetes Engine (GKE), H2O AutoML, Cloud Dataflow, Helm, GitLab CI/CD
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring