Ahmed is available for hire
Hire AhmedAhmed Mukhtar
Verified Expert in Engineering
Database Developer
London, United Kingdom
Toptal member since August 12, 2020
Bio
Ahmed is a principal data engineer with over 13 years of experience with data: pipeline construction, modeling, and visualization for companies like Skyscanner, SumUp, Noon, Floranow, OLX, and IBM. He possesses expert-level skills in Python and SQL. He also has hands-on experience developing infrastructure from scratch for cloud-based and on-premise solutions that scale. Ahmed transforms raw data into actionable insights that ensure products function well.
Portfolio
Rightmove
Google BigQuery, Terraform, Google Cloud Platform (GCP), Apache Airflow...
Transit Technologies
Google BigQuery, Data Warehousing, Data Engineering, BigQuery, Shell, JavaScript
VAS Group
Amazon QuickSight, Amazon Web Services (AWS), Data Pipelines, Documentation...
Experience
- SQL - 13 years
- Python 3 - 11 years
- Data Warehousing - 11 years
- Business Intelligence (BI) - 10 years
- Google BigQuery - 5 years
- Apache Airflow - 3 years
- Apache Kafka - 3 years
- Snowflake - 2 years
Work Experience
Principal Data Engineer
2024 - PRESENT
Rightmove
- Led the implementation of a data mesh for the company.
- Oversaw data governance efforts for the company.
- Managed the adoption of data products across the company.
Technologies: Google BigQuery, Terraform, Google Cloud Platform (GCP), Apache Airflow, Tableau, Looker, Data Mesh, Data Analytics, Data Build Tool (dbt), Python 3, BigQuery, Data Governance, Shell
Data Engineer
2026 - 2026
Transit Technologies
- Created MySQL and BigQuery data validation frameworks.
- Optimized MySQL queries to ensure data ingestion within the available time window.
- Created shell scripts to optimize pipelines for efficient data ingestion into BigQuery.
Technologies: Google BigQuery, Data Warehousing, Data Engineering, BigQuery, Shell, JavaScript
BI Developer
2024 - 2025
VAS Group
- Created complex datasets and analysis on AWS quicksight using Postgres Aurora.
- Optimized back end for AWS Quicksight dashboard by creating layered datasets.
- Extracted complex logic from quicksight calculated fields and implemented it in SQL.
Technologies: Amazon QuickSight, Amazon Web Services (AWS), Data Pipelines, Documentation, PostgreSQL
Data Engineer
2024 - 2024
PepsiCo
- Implemented a Snowflake infrastructure using Terraform.
- Migrated hundreds of terabytes of data from Teradata to Snowflake.
- Utilized dbt, Apache Airflow, Snowflake, Terraform, and Alembic for data engineering tasks.
Technologies: Data Engineering, Data Build Tool (dbt), SQL, Python, Apache Airflow, Data Pipelines, Data Modeling, Data Analytics, Azure, Python 3, Amazon Web Services (AWS), Data Lakes, Data Governance, Shell
Senior Data Engineer
2021 - 2024
Skyscanner
- Created config-driven data pipelines using Databricks with PySpark to push events (clicks/revenue) data to marketing platforms like Google Ads, Facebook Business Manager, and Criteo by calling their APIs.
- Created delta tables and DLT pipelines with autoloader for both batch and real-time stream ingestion use cases.
- Configured Unity Catalog for access management, lineage, and data discovery use cases.
- Created Terraform modules to manage the AWS infrastructure.
Technologies: Databricks, Apache Spark, Python, Marketing Technology (MarTech), ETL, PySpark, Data Engineering, Data Visualization, Terraform, Reporting, AWS Lambda, Data Build Tool (dbt), Data Warehouse Design, Data Warehousing, SQL, Tableau, Redshift, Test-driven Development (TDD), Apache Airflow, Amazon Athena, Cloud, Digital Marketing, Data, PostgreSQL, Data Architecture, Analytics, Delta Live Tables (DLT), Google Ads, Data Modeling, Data Analytics, Python 3, Amazon Web Services (AWS), Data Lakes, Amazon Redshift, Data Governance, JavaScript
Snowflake Data Engineer
2022 - 2023
Appex Group, Inc.
- Set up the marketing data infrastructure from scratch.
- Made integrations with various marketing partners like Apple store connect, Apple search ads, mixpanel, AppsFlyer, etc.
- Created marketing dashboards for the back and front ends.
Technologies: Snowflake, Redshift, Business Intelligence (BI), Data Warehouse Design, Query Optimization, PostgreSQL, ETL, Data Engineering, Data Visualization, Reporting, Data Architecture, Data Build Tool (dbt), Data Warehousing, SQL, Tableau, Test-driven Development (TDD), Apache Airflow, Python, Cloud, Digital Marketing, Data, Looker, Analytics, Data Modeling, Data Analytics, Python 3, Amazon Web Services (AWS)
Senior Data Engineer
2020 - 2021
SumUp
- Migrated the SumUp data warehouse from the legacy PostgreSQL data warehouse to Snowflake.
- Created the data warehouse access management framework for 1,000+ SumUp employees.
- Designed and implemented data marts and models on Snowflake capable of real-time and batch ingestion.
Technologies: Snowflake, Apache Kafka, Data Lakes, Streaming, MySQL, ETL, Data Engineering, Data Visualization, Terraform, Reporting, Data Architecture, AWS Lambda, Data Build Tool (dbt), Data Warehouse Design, Data Warehousing, SQL, Business Intelligence (BI), Tableau, Redshift, Test-driven Development (TDD), Apache Airflow, Python, Cloud, Data, PostgreSQL, Analytics, Data Modeling, Python 3, Amazon Web Services (AWS), Data Governance
Lead Data Engineer
2019 - 2020
Noon
- Developed a no-code self-service ETL platform for data analysts using Apache Airflow.
- Developed data marts for various business areas, including marketplace, warehouse operations, marketing, retail, logistics, and finance.
- Created a pricing engine using internal and external competition data (data scraping).
- Established the team and represented data engineering to internal and external stakeholders.
- Created multiple dashboards covering multiple aspects of eCommerce business using Tableau and Power BI.
Technologies: Google Cloud Storage, Google BigQuery, Composer, Google, Apache Airflow, Apache Kafka, PostgreSQL, MySQL, ETL, BigQuery, Data Engineering, Microsoft Power BI, Data Visualization, Reporting, Data Architecture, AWS Lambda, Azure, Data Warehouse Design, Data Warehousing, SQL, Business Intelligence (BI), Tableau, Python, Cloud, Digital Marketing, Data, Looker, Analytics, Marketing Technology (MarTech), Google Ads, Data Modeling, Data Analytics, Python 3, Google Cloud Platform (GCP), Data Lakes, Data Governance, Shell
Lead Data Engineer
2017 - 2019
Fetchr
- Established and led the data engineering and BI team for Fetchr.
- Represented the data team in various audits and due diligence exercises for compliance and fundraising.
- Created end-to-end data infrastructure capable of catering to company-wide data requirements.
- Built near real-time operational dashboards using AWS QuickSight for the logistics operations team.
- Developed a strategic dashboard directly for the CEO's and COO's visibility using AWS QuickSight.
Technologies: Amazon Web Services (AWS), Amazon Elastic MapReduce (EMR), Amazon S3 (AWS S3), Redshift, PostgreSQL, MySQL, Amazon RDS, ETL, Data Engineering, Data Visualization, Reporting, Data Architecture, Data Warehouse Design, Data Warehousing, SQL, Business Intelligence (BI), Tableau, Apache Airflow, Python, Cloud, Data, Analytics, Amazon QuickSight, Data Modeling, Data Analytics, Python 3, Data Lakes, Amazon Redshift, Data Governance, Shell
Senior Data Engineer
2015 - 2017
Dubizzle (Nasper Classifieds)
- Built an attribution and recommendation engine that decreased market spend by 30%.
- Created an in-house tool for easy integration with various APIs and databases.
- Managed all aspects of data warehousing, including ETL (Pentaho Data Integration), database designs, BI reporting (MicroStrategy), and the day-to-day data warehouse operations.
Technologies: Amazon Web Services (AWS), Amazon S3 (AWS S3), Digital Marketing, SQL, Python, Excel 365, ETL, Data Engineering, Data Visualization, Reporting, Data Warehouse Design, Data Warehousing, Business Intelligence (BI), Redshift, Cloud, Data, Data Architecture, Analytics, Marketing Technology (MarTech), Google Ads, Data Modeling, Data Analytics, Amazon Redshift
Business Analytics and Data Warehousing Consultant
2014 - 2015
IBM
- Designed and implemented the ETL for Etisalat Telecom UAE (IBM telecommunications data model).
- Implemented the data model for predictive analytics for server incident reduction for IBM data centers.
- Worked as an IBM DB2 and Netezza database administrator.
Technologies: Netezza, IBM Db2, SQL, Python, IBM Cognos, Data, Excel 365, ETL, Reporting, Data Warehousing, Data Architecture, Analytics, Data Analytics, Shell
Project History
Implementation of DWH on Google BigQuery with Real-time Data Ingestion
I created a real-time data pipeline by reading MySQL bin logs, pushing the data to Google Pub/Sub, and ingesting them in real time to Google BigQuery—the entire infrastructure functions at approximately 1 TB of data per day.
Snowflake Data Warehouse Implementation with Real-time Data Ingestion
I implemented an end-to-end data warehouse on AWS using Snowflake. I implemented changes to data capture from source systems and real-time ingestion using snowpipes. I created a framework to implement all schema changes using Liquibase.
Education
2006 - 2010
Bachelor's Degree in Compter Engineering
National University of Science and Technology - Pakistan
Skills
Libraries/APIs
PySpark
Tools
Apache Airflow, Tableau, BigQuery, Microsoft Power BI, Terraform, Looker, Amazon QuickSight, Amazon Elastic MapReduce (EMR), Amazon Athena, Composer, IBM Cognos, Cloud Dataflow, Shell
Languages
Python 3, SQL, Snowflake, Python, JavaScript
Paradigms
Business Intelligence (BI), Test-driven Development (TDD), ETL
Platforms
Apache Kafka, Google Cloud Platform (GCP), Amazon Web Services (AWS), Databricks, AWS Lambda, Azure, Google Ads
Storage
Database Modeling, Redshift, Amazon S3 (AWS S3), Data Lakes, PostgreSQL, MySQL, Data Pipelines, Google Cloud Storage, IBM Db2, Netezza
Frameworks
Delta Live Tables (DLT), Apache Spark
Other
Data Engineering, Google BigQuery, Data Warehousing, Data Warehouse Design, Marketing Technology (MarTech), Query Optimization, Data Visualization, Amazon RDS, Excel 365, Reporting, Data Architecture, Data Build Tool (dbt), Analytics, Data Mesh, Data Analytics, Documentation, Data Modeling, Amazon Redshift, Data Governance, Entity Resolution, Machine Learning, Machine Learning Operations (MLOps), Google, Cloud, Storage, Digital Marketing, Data, Change Data Capture, Streaming, Artificial Intelligence (AI)
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring