Muhammad Shoaib, Developer in Málaga, Spain
Muhammad is currently unavailable

Muhammad Shoaib

Bio

Muhammad is a data architect, BI, and data engineering specialist with 13+ years of experience delivering comprehensive data solutions, including data warehousing, ETL/ELT, BI, and modern data stack implementations for enterprise clients across the US and Europe. He has a proven track record in full-lifecycle project delivery, advanced data modeling, architecture design, and leading managed services across pharmaceutical, telecommunications, financial, and regulatory sectors.

Portfolio

Self-employed
Azure Data Factory (ADF), Snowflake, Data Build Tool (dbt), GitLab CI/CD...
PepsiCo Global - Main
SQL, Tableau, Snowflake, Apache Airflow, DB, Data Engineering...
360factors, Inc.
Apache Airflow, Azure SQL, Business Intelligence (BI), Microsoft Power BI...

Experience

  • Data Engineering - 13 years
  • SQL Server Integration Services (SSIS) - 13 years
  • Business Intelligence (BI) - 13 years
  • Data Warehousing - 13 years
  • SQL - 13 years
  • Data Build Tool (dbt) - 5 years
  • Azure Data Factory (ADF) - 4 years
  • Snowflake - 4 years

Preferred Environment

Data Engineering, Data Warehousing, Data Build Tool (dbt), Data Analytics, Microsoft Power BI, Azure Data Factory (ADF), Apache Airflow, Microsoft BI Stack, Snowflake, Business Intelligence (BI)

The most amazing...

...thing I've done is deliver enterprise-wide data solutions, from modeling to managed services, enabling insights and compliance.

Work Experience

Data Architect | Data Engineer (Business Intelligence, Data Warehouse, and ETL/ELT)

2022 - PRESENT
Self-employed
  • Designed and implemented end-to-end data analytics and visualization solutions, delivering actionable insights to stakeholders across multiple business units.
  • Collaborated with business and technical teams to define project scope, translating requirements into scalable architecture and implementation plans.
  • Orchestrated cross-team collaborations to unify fragmented data sources, enabling a single source of truth for enterprise reporting.
Technologies: Azure Data Factory (ADF), Snowflake, Data Build Tool (dbt), GitLab CI/CD, CI/CD Pipelines, Python, Talend Data Integration, Azure SQL, Microsoft BI Stack, Microsoft Access, Visual Basic for Applications (VBA), Data Engineering, Database Design, Database Schema Design, REST APIs, Cloud Firestore, Data Orchestration, Salesforce, FTP, Azure, SQL, Microsoft Excel, APIs, Looker, BigQuery, Data Collection, ETL Implementation & Design, Talend ETL, Data Integration, Visual Basic, ETL, Data Architecture, Customer Relationship Management (CRM), ETL Pipelines, MotherDuck, Airtable, Airbyte, Business Intelligence (BI), Data Cleansing, Reporting, Data Reporting, Google BigQuery, Data Center Infrastructure, Tableau, Dashboard Design, Communication, Design, Azure SQL Data Warehouse, Azure SQL Databases, Team Leadership, Data Migration, Power BI Desktop, Azure Cosmos DB

DataOps Engineer

2021 - 2022
PepsiCo Global - Main
  • Monitored daily ETL pipelines, processing over two million records across multiple data sources, ensuring 99.9% data accuracy and timely availability for reporting.
  • Collaborated with business stakeholders to gather requirements, translating them into actionable data solutions that supported strategic decision-making.
  • Maintained production data pipelines, resolving system failures within SLA and ensuring uninterrupted access to critical operational data.
Technologies: SQL, Tableau, Snowflake, Apache Airflow, DB, Data Engineering, Data Build Tool (dbt), Monte Carlo, Data Dogs, Amazon S3 (AWS S3), Database Design, Data Orchestration, Amazon Web Services (AWS), Microsoft Excel, Data Collection, Data Integration, ETL, ETL Pipelines, Business Intelligence (BI), Data Cleansing, Data Reporting, Dashboard Design, Communication, Design, Team Leadership

Senior Principal BI/DWH Engineer

2020 - 2021
360factors, Inc.
  • Managed the data warehouse production environment, monitoring 100% of ETL processes daily and resolving data anomalies within SLA, ensuring 99.9% data accuracy.
  • Led end-to-end project lifecycle activities, including planning, estimation, development, testing, and deployment, delivering projects on time with zero critical production defects.
  • Spearheaded knowledge-sharing sessions, upskilling 5+ team members in best practices for database design, ETL optimization, and machine learning implementation.
Technologies: Apache Airflow, Azure SQL, Business Intelligence (BI), Microsoft Power BI, Tableau, Python, Continuous Integration (CI), Continuous Development (CD), Talend Data Integration, PostgreSQL, MySQL, Dashboards, Data Visualization, Power BI Embedded, Microsoft Excel, Data Engineering, Database Design, Database Schema Design, Data Orchestration, FTP, SFTP, Azure, SQL, Data Collection, Talend ETL, Data Integration, ETL, Data Architecture, ETL Pipelines, Airbyte, Data Cleansing, Reporting, Data Center Infrastructure, Dashboard Design, Communication, Design, Azure SQL Data Warehouse, Azure SQL Databases, Team Leadership, Data Migration, Power BI Desktop

Principal BI/DWH Engineer

2018 - 2020
360factors, Inc.
  • Modeled and implemented the data warehouse architecture, analytics data stores, and reporting for a SaaS-based platform.
  • Developed target data models, including data policies for sensitive data assets, security policies, back-up, and recovery specifications.
  • Applied techniques to optimize performance with large data sets at both the ETL and reporting levels.
  • Migrated the data from a client's existing running application to a newly deployed system to make their data operational and meaningful as per the new system.
Technologies: MySQL, Microsoft SQL Server, Data Analysis, Data Analytics, SQL, SQL Server Integration Services (SSIS), ETL, ETL Development, Data Architecture, Data Pipelines, Data Modeling, Data Warehousing, Data Warehouse Design, Database Modeling, Star Schema, Database Management, DAX, Database Design, Database Administration (DBA), Relational Databases, PostgreSQL, Databases, ETL Tools, Microsoft Power BI, Dashboards, Data Visualization, Power BI Embedded, Data Engineering, Database Schema Design, Data Orchestration, FTP, SFTP, Microsoft Excel, Data Collection, ETL Implementation & Design, Talend ETL, Data Integration, ETL Pipelines, Business Intelligence (BI), Data Cleansing, Reporting, Data Reporting, Data Center Infrastructure, Tableau, Dashboard Design, Communication, Design, Azure SQL Databases, Team Leadership

Senior ETL/DWH/BI Engineer

2016 - 2018
Afiniti
  • Worked closely with analysts and data scientists to develop meaningful data to model machine learning algorithms.
  • Verified the quality and integrity of data as part of this process (including reconciling key metrics).
  • Assisted in both ad-hoc requests and regular reports for various business segments.
  • Collaborated with several teams to understand their business needs and translate them into actionable data analysis and reports.
  • Planned, designed, and streamlined ETL tasks, verifying data quality and integrity as part of this process.
Technologies: MySQL, Microsoft SQL Server, Data Analysis, Data Analytics, SQL, SQL Server Integration Services (SSIS), ETL, ETL Development, Data Architecture, Data Pipelines, Data Modeling, Data Warehousing, Data Warehouse Design, Database Modeling, Star Schema, Database Management, Database Design, Database Administration (DBA), Relational Databases, Databases, ETL Tools, Python, Dashboards, Data Engineering, Database Schema Design, Data Orchestration, Machine Learning, Data Science, FTP, SFTP, VPN, Microsoft Excel, ETL Implementation & Design, Talend ETL, Data Integration, ETL Pipelines, Business Intelligence (BI), Data Cleansing, Reporting, Communication, Design, Azure SQL Databases, Team Leadership, Data Migration

Senior ETL/DWH/BI Consultant

2014 - 2016
Qordata (formally known as Streebo IM)
  • Led the team of consultants on different engagements of ETL and data warehousing.
  • Researched, wrote, and edited the documentation and technical requirements, including evaluation plans, test results, technical manuals, and formal recommendations and reports.
  • Developed end-to-end, various data-driven solutions, including analysis, architecture, design, development, deployment, and maintenance.
  • Offered thought-leadership and proficiency in the architecture, design, and evolution of the data management system while interacting with business users to ensure BI data architecture and organizational needs are met.
  • Participated in organizational growth by providing in-house technical training, conducting interviews, and enhancing processes, standards, and other related activities that contribute toward operational excellence.
Technologies: SSAS, Microsoft SQL Server, Data Analysis, Data Analytics, SQL, SQL Server Integration Services (SSIS), ETL, ETL Development, Data Architecture, Data Pipelines, Data Modeling, Data Warehousing, Data Warehouse Design, Consulting, Database Modeling, Star Schema, Database Management, DAX, Database Design, Relational Databases, Databases, ETL Tools, Dashboards, Data Visualization, Microsoft Excel, Data Engineering, Database Schema Design, Data Orchestration, ASP.NET, C#, SFTP, VPN, .NET, ETL Implementation & Design, Data Integration, ETL Pipelines, Business Intelligence (BI), Data Cleansing, Reporting, Data Reporting, Communication, Team Leadership, Data Migration

Technical Consultant on ETL, Data Warehouse (DWH), and Business Intelligence (BI)

2012 - 2014
Streebo
  • Designed and implemented various reports and prepared dashboards.
  • Engineered the process to extract data from multiple sources and performed data preprocessing using ETL tools.
  • Provided technical support in database implementation and deployment.
  • Performed load-optimization process for Kalido DIW, SSIS packages, and Microsoft SQL Server stored procedures for a worldwide assurance company.
  • Contributed to the POC of an MDM for a medical malpractice insurance company.
Technologies: Spotfire, Microsoft SQL Server, Data Analysis, Data Analytics, SQL, SQL Server Integration Services (SSIS), ETL, ETL Development, Data Pipelines, Data Warehouse Design, Data Warehousing, Consulting, Database Modeling, Star Schema, Database Management, DAX, Database Design, Relational Databases, Databases, IBM InfoSphere (DataStage), ETL Tools, Data Visualization, Data Engineering, Data Orchestration, SFTP, VPN, .NET, Microsoft Excel, ETL Implementation & Design, Data Integration, ETL Pipelines, Business Intelligence (BI), Data Cleansing, Reporting, Data Reporting, Communication, Data Migration

Experience

A Comparative Study of Data-mining Techniques for HCV Patients’ Data

I applied various data-mining techniques to the patient data of Hepatitis C to observe the high prevalence of the risk of the Hepatitis C virus. The results obtained by the applied algorithms of this paper were superior to those of other techniques found in related research papers.

Reusability of Data Marts

I created a generic data mart based on the source system, which was deployed to multiple clients to meet the required reporting purposes with little customization (if needed) on the reporting end.

Managed Services

I led a team of consultants on a managed services project focused on the production monitoring of Enterprise Data Warehouse (EDW) loads during nightly builds. Our responsibilities included tracking ETL job executions, identifying failures or anomalies, and performing timely issue resolution across both Level-1 and Level-2 support tiers to ensure data integrity and minimal downtime.

Data Engineering for AI Models

I engineered and transformed raw data into a structured format optimized for training and deploying machine learning (ML) models. Additionally, I developed a robust mechanism to detect data gaps and monitor AI models' performance over time, ensuring reliability and accuracy in production environments.

Design and Implementation of a Data Warehouse for a SaaS Platform

After researching and understanding the system, I designed, developed, fixed the bugs, and optimized the performance of a type of SaaS-based multi-tenant risk and compliance software, enabling the reporting feature on top of it.

Education

2008 - 2011

Bachelor of Science Degree in Computer Science

University of Karachi - Karachi, Pakistan

Certifications

DECEMBER 2023 - PRESENT

Talend Data Integration Certified Developer using Talend Studio

Qlik

JANUARY 2023 - PRESENT

Microsoft Certified: Azure Data Engineer Associate

Microsoft

SEPTEMBER 2014 - PRESENT

Microsoft Certified Solutions Associate: SQL Server 2012/2014

Microsoft

Skills

Libraries/APIs

REST APIs

Tools

SSAS, Talend ETL, Talend Data Integration, Microsoft Power BI, Tableau, Microsoft Access, Microsoft Excel, IBM InfoSphere (DataStage), Spotfire, Apache Airflow, VPN, Looker, BigQuery, Power BI Desktop, GitLab CI/CD, Power BI Embedded

Languages

SQL, Python, Visual Basic for Applications (VBA), Snowflake, Visual Basic, C#

Paradigms

ETL Implementation & Design, ETL, Business Intelligence (BI), Database Design, Continuous Integration (CI), Continuous Development (CD)

Platforms

Azure, Azure SQL Data Warehouse, Microsoft BI Stack, Airbyte, Azure Synapse Analytics, Amazon Web Services (AWS), Salesforce

Storage

Microsoft SQL Server, Databases, Data Pipelines, Database Modeling, Database Management, SQL Server Integration Services (SSIS), MySQL, Azure SQL Databases, PostgreSQL, Database Administration (DBA), Relational Databases, Data Integration, Azure SQL, DB, Amazon S3 (AWS S3), Cloud Firestore, Azure Cosmos DB

Frameworks

ASP.NET, .NET

Other

Data Modeling, Data Analysis, Data Analytics, Data Architecture, Star Schema, Data Warehousing, Data Engineering, ETL Development, ETL Tools, Data Build Tool (dbt), Data Transformation, Database Schema Design, Data Orchestration, Data Collection, ETL Pipelines, Data Cleansing, Data Center Infrastructure, Communication, Design, Team Leadership, Data Migration, Computer Science, Consulting, DAX, Data Warehouse Design, Azure Data Factory (ADF), Monte Carlo, CI/CD Pipelines, Dashboards, Data Visualization, Machine Learning, Data Science, FTP, SFTP, APIs, MotherDuck, Airtable, Reporting, Data Reporting, Google BigQuery, Dashboard Design, Data Dogs, Sage ERP, Customer Relationship Management (CRM)

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring