Pulkit Jain, Developer in Pune, Maharashtra, India
Pulkit is available for hire
Hire Pulkit

Pulkit Jain

Verified Expert  in Engineering

Azure Data Engineer and BI Developer

Pune, Maharashtra, India

Toptal member since February 15, 2021

Expertise
Data EngineeringSQLBusiness Intelligence DevelopmentCloud EngineeringData WarehouseAzureETLDatabaseData ScienceDatabricks
Bio

Pulkit is a Microsoft-certified Azure data engineer and Power BI developer with more than six years of experience in data engineering and business intelligence. He has designed and implemented end-to-end data solutions in Azure. Pulkit is an expert in the Azure suite of products, Azure Data Factory, Synapse, Azure Data Lake, Databricks, SQL servers, SSIS, and Power BI.

Portfolio

KCS iT Project Management
Azure Data Factory (ADF), SQL, Azure CLI, Azure Blobs, ETL, Data Warehousing...
Amdocs
Azure, SQL, Microsoft Power BI, Azure Data Factory (ADF), DAX...
Microsoft (via TCS)
Azure Data Factory (ADF), SQL, Azure SQL Databases, Microsoft SQL Server...

Experience

  • Azure Data Factory (ADF) - 7 years
  • Data Engineering - 6 years
  • SQL - 4 years
  • Azure - 4 years
  • Cloud - 4 years
  • Business Intelligence (BI) - 3 years
  • Microsoft Power BI - 3 years
  • Azure Data Lake - 3 years

Availability

Part-time

Preferred Environment

Azure, SQL, Microsoft Power BI, Azure Data Factory (ADF), Business Intelligence (BI), Data Engineering, Azure Data Lake, Azure Synapse, Data Warehousing, ETL

The most amazing...

...thing I've created was an Azure Data Factory pipeline that decreased the pipeline runtime from a couple of days to less than two hours.

Work Experience

Azure Data Engineer

2021 - PRESENT
KCS iT Project Management
  • Built 200+ Azure Data Factory pipelines that could extract the data from many diverse sources, transform and load it to different sink destinations, and even refresh the Power BI dashboards upon completion with automated scheduled triggers.
  • Archived more than 50TB of data from multiple applications based on complex business rules to cold storage.
  • Created complex SQL procedures and queries to transform, clean, and process huge data as per the business logic.
  • Composed advance reports and real-time dashboards using Microsoft Power BI, Dax, and Power Query.
Technologies: Azure Data Factory (ADF), SQL, Azure CLI, Azure Blobs, ETL, Data Warehousing, Data Warehouse Design, Microsoft Power BI, Azure SQL Data Warehouse, Dedicated SQL Pool (formerly SQL DW), Azure SQL, Data Cleansing, Business Intelligence (BI), Power Query, Azure DevOps

Data Warehouse and BI Developer

2020 - 2020
Amdocs
  • Created complex data models inside Power BI with different cardinalities; and became deeply acquainted with cardinalities and cross-filtering features of Microsoft Power BI.
  • Used SQL Profiler to track down the SQL query that Power BI sent to Microsoft SQL Server and optimized such queries.
  • Created data audits and data validation to check data integrity.
  • Implemented transformation logic and cleansing logic in Azure Databricks using Spark SQL in SQL context only.
  • Created connections inside Azure Databricks to connect with Azure Blob storage using a secret scope and secret keys.
Technologies: Azure, SQL, Microsoft Power BI, Azure Data Factory (ADF), DAX, Business Intelligence (BI), ETL, Azure DevOps

Azure Data Engineer

2018 - 2020
Microsoft (via TCS)
  • Migrated legacy data workloads for more than 50+ complex modules from on-premise integration packages to Azure Data Factory, removed their dependencies from on-premise infrastructure, and migrated every intricacy to Azure PaaS.
  • Coordinated with data scientist teams to prepare the data for data science experiments and orchestrated these experiments in Azure Data Factory pipelines in the form of ML Studio Experiment and Databricks notebook.
  • Optimized the degree of parallelism and computing power for the best results in Azure Data Factory pipelines and used complex for-loops to attain the shortest runtime possible.
Technologies: Azure Data Factory (ADF), SQL, Azure SQL Databases, Microsoft SQL Server, Azure DevOps

Azure Data Engineer

2015 - 2018
Tata Consultancy Services
  • Intensively worked in Azure Data Factory, Azure, Blob Storage, Azure SQL Database, Azure Synapse, and Azure Databricks.
  • Used Azure DevOps for versioning and repositories in Azure Data factory. Implemented CI/CD deployment using Azure Resource Management template for Azure Data Factory multi-environment deployment.
  • Extracted data from SAS cube using Azure Data Factory. Implemented Azure SSIS integration runtime and Azure SQL database catalog to store SIIS packages.
  • Created and configured integration runtimes in different environments with optimized linked services and datasets.
Technologies: Azure, Microsoft Power BI, Azure Data Factory (ADF), SQL, Azure SQL, Azure Databricks, Dedicated SQL Pool (formerly SQL DW), Azure SQL Data Warehouse, Business Intelligence (BI), ETL, Azure DevOps

Experience

Finance Business Intelligence

I worked for the Microsft Finance project as an Azure data engineer, where I handled the complete extraction, transformation, and loading of data using Azure Data tools. I liaised with data scientists to integrate these data pipelines with ML experiments and developed and integrated Power BI reports to display rich, informative dashboards with forecast numbers. These numbers were displayed on the public website of Microsoft every month.

Azure Migration

I migrated more than 50 complex modules from legacy SSIS packages and SQL Server jobs to Azure Data Factory pipelines. I also implemented data storage using Azure SQL Database and Azure Blob Storage, and I made the whole workflow on-premise independent.

AT&T Power BI Migration

I successfully migrated hundreds of reports to Power BI which get utilized by 2,000+ users daily. I also created a shared Power BI Dataset on top of which hundreds of Power BI started running. The aim of the project was to migrate reports SAP BI to Power BI and I was a core member of that team. This work included developing reports and models as well as deployment and tracking performance improvement statistics.

Education

2013 - 2017

Bachelor's Degree in Information Technology

College of Technology, Pantnagar University - Uttarakhand, India

2012 - 2013

Associate Degree in Mathematics and Computer Science

Central Board of Secondary Education - Uttarakhand, India

Certifications

FEBRUARY 2021 - PRESENT

DP-200: Implementing an Azure Data Solution

Microsoft

AUGUST 2020 - AUGUST 2022

Exam DA-100: Analyzing Data with Microsoft Power BI

Microsoft

APRIL 2020 - PRESENT

Exam AZ-900: Microsoft Azure Fundamentals

Microsoft

Skills

Tools

Microsoft Power BI, Synapse, Power Query

Languages

SQL

Paradigms

Business Intelligence (BI), ETL, Azure DevOps

Platforms

Azure, Azure SQL Data Warehouse, Dedicated SQL Pool (formerly SQL DW), Databricks, Azure Synapse

Storage

Azure SQL, Databases, Azure Cloud Services, SQL Server Integration Services (SSIS), Azure Blobs, SQL Server 2014, Azure SQL Databases, Microsoft SQL Server

Other

Azure Data Factory (ADF), Data Engineering, Data Warehousing, Azure Databricks, Azure Data Lake, Data Architecture, Data Warehouse Design, Cloud, Data Analytics, Computer, Computer Science, DAX, Azure CLI, Data Cleansing, Blob Storage

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring