Ahmed Mukhtar, Developer in London, United Kingdom
Ahmed is available for hire
Hire Ahmed

Ahmed Mukhtar

Verified Expert  in Engineering

Bio

Ahmed is a principal data engineer with over 13 years of experience with data: pipeline construction, modeling, and visualization for companies like Skyscanner, SumUp, Noon, Floranow, OLX, and IBM. He possesses expert-level skills in Python and SQL. He also has hands-on experience developing infrastructure from scratch for cloud-based and on-premise solutions that scale. Ahmed transforms raw data into actionable insights that ensure products function well.

Portfolio

Rightmove
Google BigQuery, Terraform, Google Cloud Platform (GCP), Apache Airflow...
VAS Group
Amazon QuickSight, Amazon Web Services (AWS), Data Pipelines, Documentation...
PepsiCo
Data Engineering, Data Build Tool (dbt), SQL, Python, Apache Airflow...

Experience

  • SQL - 13 years
  • Python 3 - 11 years
  • Data Warehousing - 11 years
  • Business Intelligence (BI) - 10 years
  • Google BigQuery - 5 years
  • Apache Airflow - 3 years
  • Apache Kafka - 3 years
  • Snowflake - 2 years

Availability

Part-time

Preferred Environment

Amazon Web Services (AWS), Redshift, Apache Kafka, Snowflake, Python, SQL, Apache Airflow, Google Cloud Platform (GCP), Terraform, Amazon RDS

The most amazing...

...thing I've accomplished is creating data engineering infrastructure and teams from scratch multiple times during my career.

Work Experience

Principal Data Engineer

2024 - PRESENT
Rightmove
  • Led the implementation of a data mesh for the company.
  • Oversaw data governance efforts for the company.
  • Managed the adoption of data products across the company.
Technologies: Google BigQuery, Terraform, Google Cloud Platform (GCP), Apache Airflow, Tableau, Looker, Data Mesh, Data Analytics, Data Build Tool (dbt), Python 3, BigQuery

BI Developer

2024 - 2025
VAS Group
  • Created complex datasets and analysis on AWS quicksight using Postgres Aurora.
  • Optimized back end for AWS Quicksight dashboard by creating layered datasets.
  • Extracted complex logic from quicksight calculated fields and implemented it in SQL.
Technologies: Amazon QuickSight, Amazon Web Services (AWS), Data Pipelines, Documentation, PostgreSQL

Data Engineer

2024 - 2024
PepsiCo
  • Implemented a Snowflake infrastructure using Terraform.
  • Migrated hundreds of terabytes of data from Teradata to Snowflake.
  • Utilized dbt, Apache Airflow, Snowflake, Terraform, and Alembic for data engineering tasks.
Technologies: Data Engineering, Data Build Tool (dbt), SQL, Python, Apache Airflow, Data Pipelines, Data Modeling, Data Analytics, Azure, Python 3, Amazon Web Services (AWS), Data Lakes

Senior Data Engineer

2021 - 2024
Skyscanner
  • Created config-driven data pipelines using Databricks with PySpark to push events (clicks/revenue) data to marketing platforms like Google Ads, Facebook Business Manager, and Criteo by calling their APIs.
  • Created delta tables and DLT pipelines with autoloader for both batch and real-time stream ingestion use cases.
  • Configured Unity Catalog for access management, lineage, and data discovery use cases.
  • Created Terraform modules to manage the AWS infrastructure.
Technologies: Databricks, Apache Spark, Python, Marketing Technology (MarTech), ETL, PySpark, Data Engineering, Data Visualization, Terraform, Reporting, AWS Lambda, Data Build Tool (dbt), Data Warehouse Design, Data Warehousing, SQL, Tableau, Redshift, Test-driven Development (TDD), Apache Airflow, Amazon Athena, Cloud, Digital Marketing, Data, PostgreSQL, Data Architecture, Analytics, Delta Live Tables (DLT), Google Ads, Data Modeling, Data Analytics, Python 3, Amazon Web Services (AWS), Data Lakes

Snowflake Data Engineer

2022 - 2023
Appex Group, Inc.
  • Set up the marketing data infrastructure from scratch.
  • Made integrations with various marketing partners like Apple store connect, Apple search ads, mixpanel, AppsFlyer, etc.
  • Created marketing dashboards for the back and front ends.
Technologies: Snowflake, Redshift, Business Intelligence (BI), Data Warehouse Design, Query Optimization, PostgreSQL, ETL, Data Engineering, Data Visualization, Reporting, Data Architecture, Data Build Tool (dbt), Data Warehousing, SQL, Tableau, Test-driven Development (TDD), Apache Airflow, Python, Cloud, Digital Marketing, Data, Looker, Analytics, Data Modeling, Data Analytics, Python 3, Amazon Web Services (AWS)

Senior Data Engineer

2020 - 2021
SumUp
  • Migrated the SumUp data warehouse from the legacy PostgreSQL data warehouse to Snowflake.
  • Created the data warehouse access management framework for 1,000+ SumUp employees.
  • Designed and implemented data marts and models on Snowflake capable of real-time and batch ingestion.
Technologies: Snowflake, Apache Kafka, Data Lakes, Streaming, MySQL, ETL, Data Engineering, Data Visualization, Terraform, Reporting, Data Architecture, AWS Lambda, Data Build Tool (dbt), Data Warehouse Design, Data Warehousing, SQL, Business Intelligence (BI), Tableau, Redshift, Test-driven Development (TDD), Apache Airflow, Python, Cloud, Data, PostgreSQL, Analytics, Data Modeling, Python 3, Amazon Web Services (AWS)

Lead Data Engineer

2019 - 2020
Noon
  • Developed a no-code self-service ETL platform for data analysts using Apache Airflow.
  • Developed data marts for various business areas, including marketplace, warehouse operations, marketing, retail, logistics, and finance.
  • Created a pricing engine using internal and external competition data (data scraping).
  • Established the team and represented data engineering to internal and external stakeholders.
  • Created multiple dashboards covering multiple aspects of eCommerce business using Tableau and Power BI.
Technologies: Google Cloud Storage, Google BigQuery, Composer, Google, Apache Airflow, Apache Kafka, PostgreSQL, MySQL, ETL, BigQuery, Data Engineering, Microsoft Power BI, Data Visualization, Reporting, Data Architecture, AWS Lambda, Azure, Data Warehouse Design, Data Warehousing, SQL, Business Intelligence (BI), Tableau, Python, Cloud, Digital Marketing, Data, Looker, Analytics, Marketing Technology (MarTech), Google Ads, Data Modeling, Data Analytics, Python 3, Google Cloud Platform (GCP), Data Lakes

Lead Data Engineer

2017 - 2019
Fetchr
  • Established and led the data engineering and BI team for Fetchr.
  • Represented the data team in various audits and due diligence exercises for compliance and fundraising.
  • Created end-to-end data infrastructure capable of catering to company-wide data requirements.
  • Built near real-time operational dashboards using AWS QuickSight for the logistics operations team.
  • Developed a strategic dashboard directly for the CEO's and COO's visibility using AWS QuickSight.
Technologies: Amazon Web Services (AWS), Amazon Elastic MapReduce (EMR), Amazon S3 (AWS S3), Redshift, PostgreSQL, MySQL, Amazon RDS, ETL, Data Engineering, Data Visualization, Reporting, Data Architecture, Data Warehouse Design, Data Warehousing, SQL, Business Intelligence (BI), Tableau, Apache Airflow, Python, Cloud, Data, Analytics, Amazon QuickSight, Data Modeling, Data Analytics, Python 3, Data Lakes

Senior Data Engineer

2015 - 2017
Dubizzle (Nasper Classifieds)
  • Built an attribution and recommendation engine that decreased market spend by 30%.
  • Created an in-house tool for easy integration with various APIs and databases.
  • Managed all aspects of data warehousing, including ETL (Pentaho Data Integration), database designs, BI reporting (MicroStrategy), and the day-to-day data warehouse operations.
Technologies: Amazon Web Services (AWS), Amazon S3 (AWS S3), Digital Marketing, SQL, Python, Excel 365, ETL, Data Engineering, Data Visualization, Reporting, Data Warehouse Design, Data Warehousing, Business Intelligence (BI), Redshift, Cloud, Data, Data Architecture, Analytics, Marketing Technology (MarTech), Google Ads, Data Modeling, Data Analytics

Business Analytics and Data Warehousing Consultant

2014 - 2015
IBM
  • Designed and implemented the ETL for Etisalat Telecom UAE (IBM telecommunications data model).
  • Implemented the data model for predictive analytics for server incident reduction for IBM data centers.
  • Worked as an IBM DB2 and Netezza database administrator.
Technologies: Netezza, IBM Db2, SQL, Python, IBM Cognos, Data, Excel 365, ETL, Reporting, Data Warehousing, Data Architecture, Analytics, Data Analytics

Experience

Implementation of DWH on Google BigQuery with Real-time Data Ingestion

I created a real-time data pipeline by reading MySQL bin logs, pushing the data to Google Pub/Sub, and ingesting them in real time to Google BigQuery—the entire infrastructure functions at approximately 1 TB of data per day.

Snowflake Data Warehouse Implementation with Real-time Data Ingestion

I implemented an end-to-end data warehouse on AWS using Snowflake. I implemented changes to data capture from source systems and real-time ingestion using snowpipes. I created a framework to implement all schema changes using Liquibase.

Education

2006 - 2010

Bachelor's Degree in Compter Engineering

National University of Science and Technology - Pakistan

Skills

Libraries/APIs

PySpark

Tools

Apache Airflow, Tableau, BigQuery, Microsoft Power BI, Terraform, Looker, Amazon QuickSight, Amazon Elastic MapReduce (EMR), Amazon Athena, Composer, IBM Cognos, Cloud Dataflow

Languages

Python 3, SQL, Snowflake, Python

Paradigms

Business Intelligence (BI), Test-driven Development (TDD), ETL

Platforms

Apache Kafka, Google Cloud Platform (GCP), Amazon Web Services (AWS), Databricks, AWS Lambda, Azure, Google Ads

Storage

Database Modeling, Redshift, Amazon S3 (AWS S3), Data Lakes, PostgreSQL, MySQL, Data Pipelines, Google Cloud Storage, IBM Db2, Netezza

Frameworks

Delta Live Tables (DLT), Apache Spark

Other

Data Engineering, Google BigQuery, Data Warehousing, Data Warehouse Design, Marketing Technology (MarTech), Query Optimization, Data Visualization, Amazon RDS, Excel 365, Reporting, Data Architecture, Data Build Tool (dbt), Analytics, Data Mesh, Data Analytics, Documentation, Data Modeling, Machine Learning, Machine Learning Operations (MLOps), Google, Cloud, Storage, Digital Marketing, Data, Change Data Capture, Streaming, Artificial Intelligence (AI)

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring