Muhammad Shoaib, Developer in Karachi, Sindh, Pakistan
Muhammad is available for hire
Hire Muhammad

Muhammad Shoaib

Verified Expert  in Engineering

Data Engineering Developer

Location
Karachi, Sindh, Pakistan
Toptal Member Since
June 18, 2020

Muhammad has several years of in-depth experience in information management practice (data warehouse, BI, ETL, and data engineering) for enterprise-level clients in the US and Europe. In past projects, he’s served in pivotal roles on end-to-end implementations—starting from requirements gathering till going live. He's also led managed services for clients in regulatory compliance, pharmaceutical, telecommunications, and insurance industries.

Portfolio

360factors, Inc.
Linux, Talend, MySQL, T-SQL (Transact-SQL), Microsoft SQL Server, Data Analysis...
Afiniti
Talend, MySQL, T-SQL (Transact-SQL), Microsoft SQL Server, Data Analysis...
Qordata (formally known as Streebo IM)
SQL Server Reporting Services (SSRS), SSAS, Microsoft SQL Server...

Experience

Availability

Part-time

Preferred Environment

Spotfire, TIBCO, SQL Server Integration Services (SSIS), Microsoft, Business, Python, MySQL, Talend, Microsoft SQL Server, SQL Server Reporting Services (SSRS), SSAS, Data Engineering, ETL, Data Warehousing, Data Warehouse Design

The most amazing...

...thing I've modeled and built is a data warehouse for a SaaS platform. I also created an ETL to devise a generic solution on a regional level data source.

Work Experience

Principal BI/DWH Engineer

2018 - PRESENT
360factors, Inc.
  • Modeled and implemented the data warehouse architecture, analytics data stores and reporting for a SaaS-based platform.
  • Developed target data models including data policies for sensitive data assets, security policies, back-up, and recovery specifications.
  • Applied techniques to optimize performances with large data sets at both the ETL and reporting levels.
  • Deployed and executed on the Linux platform.
  • Migrated the data from a client's existing running application to a newly deployed system for making their data operational and meaningful as per the new system.
Technologies: Linux, Talend, MySQL, T-SQL (Transact-SQL), Microsoft SQL Server, Data Analysis, Data Analytics, SQL, SQL Server Integration Services (SSIS), ETL, ETL Development, Data Architecture, Data Pipelines, Data Modeling, Data Warehouse Design, Data Warehousing, Database Modeling, Star Schema, Database Management, DAX, Database Design, Database Administration (DBA), Relational Databases, MySQL Server, Microsoft Business Intelligence (MBI), SQL Server BI, PostgreSQL, Databases, ETL Tools, MySQLdb, Microsoft Power BI

Senior ETL/DWH/BI Engineer

2016 - 2017
Afiniti
  • Worked closely with analysts and data scientists to develop meaningful data to model machine learning algorithms.
  • Verified the quality and integrity of data as part of this process (including the reconciliation of key metrics).
  • Assisted in both ad-hoc requests as well as regular reports for various business segments.
  • Collaborated with several teams to understand their business needs and translate them into actionable data analysis and reports.
  • Planned, designed, and streamlined ETL tasks along with verifying data quality and data integrity as part of this process.
Technologies: Talend, MySQL, T-SQL (Transact-SQL), Microsoft SQL Server, Data Analysis, Data Analytics, SQL, SQL Server Integration Services (SSIS), ETL, ETL Development, Data Architecture, Data Pipelines, Data Modeling, Data Warehouse Design, Data Warehousing, Database Modeling, Star Schema, Database Management, Database Design, Database Administration (DBA), Relational Databases, MySQL Server, SQL Server BI, Databases, ETL Tools, MySQLdb

Senior ETL/DWH/BI Consultant

2014 - 2016
Qordata (formally known as Streebo IM)
  • Led the team of consultants on different engagements of ETL and data warehousing.
  • Researched, wrote, and edited the documentation and technical requirements, including evaluation plans, test results, technical manuals, and formal recommendations and reports.
  • Developed from end to end various data-driven solutions, including the analysis, architecture, design, development, deployments, and maintenance.
  • Offered thought-leadership and proficiency in the architecture, design, and evolution of the data management system while interacting with business users to ensure BI data architecture and organizational needs are met.
  • Participated in organizational growth by providing in-house technical training, conducting interviews, and enhancing processes, standards, and other related activities that contribute toward operational excellence.
Technologies: SQL Server Reporting Services (SSRS), SSAS, Microsoft SQL Server, T-SQL (Transact-SQL), Data Analysis, Data Analytics, SQL, SQL Server Integration Services (SSIS), ETL, ETL Development, Data Architecture, Data Pipelines, Data Modeling, Data Warehousing, Data Warehouse Design, Consulting, Database Modeling, Star Schema, Database Management, DAX, Database Design, Relational Databases, Microsoft Business Intelligence (MBI), SQL Server BI, Databases, ETL Tools

Technical Consultant on ETL, Data Warehouse (DWH), and Business Intelligence (BI)

2012 - 2014
Streebo
  • Designed and implemented various reports and prepare dashboards.
  • Engineered the process to extract data from multiple sources and performed data preprocessing using ETL tools.
  • Provided technical support in a database implementation and deployment.
  • Successfully performed load-optimization process for Kalido DIW, SSIS packages, and Microsoft SQL Server stored procedures for a worldwide assurance company.
  • Contributed to the POC of an MDM for a medical malpractice insurance company.
Technologies: Spotfire, Microsoft SQL Server, T-SQL (Transact-SQL), Data Analysis, Data Analytics, SQL, SQL Server Integration Services (SSIS), ETL, ETL Development, Data Pipelines, Data Warehouse Design, Data Warehousing, Consulting, Database Modeling, Star Schema, Database Management, DAX, Database Design, Relational Databases, Microsoft Business Intelligence (MBI), SQL Server BI, Databases, IBM InfoSphere (DataStage), ETL Tools

Teacher Assistant

2013 - 2013
Karachi University
  • Conducted practical labs on artificial intelligence to undergraduate students of software engineering.
  • Educated to implement the theoretical concepts of artificial intelligence in real life with examples using a tool called Prolog.
Technologies: Prolog, T-SQL (Transact-SQL), Databases

Intern

2011 - 2011
Pakistan International Airlines
  • Participated in an internship program for applying the classroom knowledge, concepts, and group effort with the professionals at Pakistan International Airlines.
  • Proposed a remarkable solution for transforming the provident fund management from traditional paperwork to an online web-based solution.
  • Documented the needs and importance of the proposed solution.
  • Analyzed the feasibility by reporting on the project implementation, project plan, and endorsing the best technologies to achieve the desired results.
Technologies: T-SQL (Transact-SQL), Microsoft SQL Server, SQL, SQL Server Integration Services (SSIS), ETL Development, Database Modeling, Database Management, Databases

A Comparative Study of Data-mining Techniques for HCV Patients’ Data

I applied various data-mining techniques on Hepatitis C patients’ data for observing the high prevalence of risk of the Hepatitis C virus. The results obtained by the applied algorithms of this paper were superior to other techniques found in related research papers.

ETL Migration from DataStage to SSIS

During this project, I migrated an entire ETL implementation from IBM DataStage to Microsoft SSIS and ensuring that all the business rules were intact.

Reusability of Data Marts

I created a generic data mart based on the source system which were deployed to multiple clients for meeting the required reporting purposes with little customization (if needed) on the reporting end.

Managed Services

I led a team of consultants on a project for managed services for production monitoring of EDW loads over nightly builds and resolving the errors—if any—on level-1 and level-2 tiers.

Data Engineering for AI Models

I engineered the data to give it a more suitable form for modeling machine learning algorithms. I also created a mechanism for data gaps and performance monitoring of AI models.

Design and Implementation of a Data Warehouse for a SaaS Platform

After researching and understanding the system, I designed, developed, fixed the bugs, and optimized the performance of a type of SaaS-based multi-tenant risk and compliance software—enabling the reporting feature on the top of it.

Languages

T-SQL (Transact-SQL), SQL, Prolog, Python

Tools

SSAS, SQL Server BI, Microsoft Power BI, Talend ETL, IBM InfoSphere (DataStage), MySQL Workbench, Spotfire

Paradigms

ETL Implementation & Design, ETL, Business Intelligence (BI), Database Design

Platforms

Talend, Linux

Storage

Microsoft SQL Server, Databases, Data Pipelines, Database Modeling, Database Management, SQL Server Integration Services (SSIS), MySQL, MySQLdb, MySQL Server, SQL Server 2010, SQL Server Reporting Services (SSRS), SQL Server 2012, SQL Server 2014, SQL Server 2008, SQL Server 2008 R2, SQL Server 2016, PostgreSQL, Database Administration (DBA), Relational Databases, SQL Server Analysis Services (SSAS)

Other

Data Modeling, Data Analysis, Data Analytics, Data Architecture, Star Schema, Data Warehousing, Data Engineering, ETL Development, ETL Tools, Microsoft Business Intelligence (MBI), Consulting, DAX, Data Warehouse Design, ETL Testing, Computer Science, Business Intelligence Architecture

2008 - 2011

Bachelor of Science Degree in Computer Science

University of Karachi - Karachi, Pakistan

DECEMBER 2020 - PRESENT

Talend Data Integration v7 Certified Developer

Talend

SEPTEMBER 2014 - PRESENT

Microsoft® Certified Solutions Associate: SQL Server 2012/2014

Microsoft

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring