Harikesh is available for hire
Hire HarikeshHarikesh Yadav
Verified Expert in Engineering
Data Engineer and Back-end Developer
Location
New Delhi, Delhi, India
Toptal Member Since
June 18, 2020
Harikesh is a talented back-end-oriented developer with over 18 years of experience in database architecture design, database programming, database administration, data engineering, business intelligence, big data, and performance tuning. He's worked on databases with TB-level data volumes.
Portfolio
Database Consultancy LLP
Database Architecture, Azure Data Factory, Azure Functions, Azure Event Hubs...
Lifescan Labs of Illinois, LLC
Data, ETL, Data Engineering, SQL, NoSQL, Azure Databricks, Azure...
Ruth's Hospitality Group Inc - Main
Microsoft Power BI, Azure, Azure Synapse, BI Reporting
Experience
Availability
Full-time
Preferred Environment
Database Architecture, Data Warehousing, Azure, Microsoft SQL Server, Microsoft Power BI, Database Administration (DBA), Python, Amazon Web Services (AWS), Azure Data Factory, Databricks
The most amazing...
...projects I've developed are cutting-edge data and analytics solutions with terabytes of data.
Work Experience
Data Architect
2011 - PRESENT
Database Consultancy LLP
- Gained extensive experience in data engineering, cloud architecture, data architecture, ETLs, DevOps, data analysis, and big data technologies.
- Architected and implemented an end-to-end data solution in Azure and AWS with enterprise-grade scale and performance, seamless data migration, and low total cost of ownership.
- Developed and published database architecture standards and sizing guidelines. Provided SQL programming and coding optimization guidance to DB developers.
- Used SQL Sentry, SQL Profiler, extended events, execution plans, performance monitors, DMVs, and DBCC commands to identify and resolve performance issues.
- Utilized Power BI to build interactive and visually appealing dashboards and reports. Built Power BI data models and ran DAX queries and functions in Power BI.
- Implemented complex distributed and scalable data pipeline systems involving a huge amount of real-time and batch data handling using SSIS, Azure Data Factory, Databricks, AWS Glue, AWS Kinesis, etc.
- Generated a feasibility study on the SQL Server database, fixing non-compatible tables. Stored procedure and other features and made it compatible with SQL Azure on Cloud.
- Researched and developed POCs on emerging data technologies to improve new and existing solutions.
- Implemented end-to-end high availability and disaster recovery strategy in on-premise and cloud solutions.
- Developed expertise in database installation, capacity planning, high availability, disaster recovery, backup, and recovery strategy.
Technologies: Database Architecture, Azure Data Factory, Azure Functions, Azure Event Hubs, Azure SQL Databases, Database Administration (DBA), Business Intelligence (BI), Microsoft Power BI, SQL Server Integration Services (SSIS), Microsoft SQL Server, Python, Windows PowerShell, Big Data, Data Warehouse Design, Erwin, Databricks, Realtime, Amazon Web Services (AWS), Analytics, Dashboards, Data Analysis, Data Visualization, PySpark, SQL, NoSQL, MySQL, Microsoft Access, Optimization, PL/SQL Tuning, ETL, Data Lakes, Azure Databricks, Azure SQL, Spark, Azure Data Lake, Azure Cosmos DB, Data Modeling, Data Management, Data Build Tool (dbt), Azure PaaS, ELT, Real-time Data, Snowflake, Data Processing, Kubernetes, Architecture, Back-end, Cloud Infrastructure, Master Data Management (MDM), Data Pipelines, Infrastructure
Data Engineer
2023 - 2023
Lifescan Labs of Illinois, LLC
- Designed a robust system architecture using Azure Databricks, integrating Azure Data Factory, Azure Key Vault, and Azure Blob Storage to meet evolving business needs.
- Successfully set up a state-of-the-art lakehouse platform using Azure Databricks, integrating various data storage and processing technologies.
- Constructed robust data pipelines for real-time and batch data ingestion from a variety of sources, including Kafka, Azure Blob Storage, relational and NoSQL databases, and APIs.
- Orchestrated intricate data processing pipelines using Azure Data Factory, ensuring a streamlined and error-free data flow.
- Created optimized data models within the Databricks Lakehouse, ensuring data integrity and efficient access.
- Integrated advanced security features and protocols, achieving high standards of data security and compliance with industry regulations.
- Balanced budget and performance requirements by managing and optimizing costs related to data processing and storage.
Technologies: Data, ETL, Data Engineering, SQL, NoSQL, Azure Databricks, Azure, Amazon Web Services (AWS), Python, Data Processing
Power BI Developer
2022 - 2022
Ruth's Hospitality Group Inc - Main
- Engaged with business users to gather requirements, design visualizations, and provide training to use self-service BI tools.
- Created Power BI visualizations and dashboards as per the requirements.
- Analyzed the source system data sources and data warehouse.
- Created row-level security and published dashboards using Power BI workspace.
- Developed and maintained multiple Power BI dashboards and reports.
- Understanding the data connections and interdependencies between data tables in existing Cognos reports; based on that, prepared the data model in Power BI.
- Wrote extensively complex DAX queries to achieve the results.
Technologies: Microsoft Power BI, Azure, Azure Synapse, BI Reporting
SQL Optimization Developer
2021 - 2022
Agilon Health Management, Inc.
- Found and suggested areas of improvement in database architecture and designed the next-generation solution.
- Implemented database standards and naming conventions for the database objects.
- Defined, designed, analyzed, developed, documented, tested, and implemented database changes with accuracy and timeliness.
- Performed load testing before deploying major database versions to the production environment, monitoring performance, diagnosing issues, and fine-tuning the database.
Technologies: SQL, Microsoft SQL Server, SQL Stored Procedures, Python, Windows PowerShell, Amazon Web Services (AWS), Performance Tuning, SQL Performance, Database Administration (DBA), Optimization, PL/SQL Tuning, Accounting
Database Administrator
2009 - 2011
American Express
- Developed, deployed, and monitored complex DTS and SSIS packages to extract, transform, and load data into SQL server 2000 to 2005 from Mainframes, Oracle, SQL, text, and Excel sheets.
- Performed load testing before deploying major database versions to the production environment, monitoring performance, diagnosing issues, and fine-tuning the database.
- Suggested disk capacity, processors, and memory based on the capacity planning.
Technologies: SQL Server Analysis Services (SSAS), SQL Server Integration Services (SSIS), SQL Server 2005, Windows PowerShell, SQL Server Reporting Services (SSRS), Database Administration (DBA), Database Design, Data Engineering, Accounting
Database Administrator
2007 - 2009
Orange Business Services
- Created SQL scripts for maintaining administration tasks like backups, stats, and indexing. Developed and configured database replication for load sharing and disaster recovery purposes.
- Developed, deployed, and monitored complex DTS and SSIS Packages to extract, transform, and load data into SQL Server 2000, 2005 from Oracle, SQL, Text, and Excel Sheets.
- Upgraded the Microsoft SQL Server from 2000 to 2005 and DTS to SSIS packages.
Technologies: SQL Server Integration Services (SSIS), SQL Server 2005, Database Administration (DBA), Database Development
Software Engineer
2005 - 2007
Teckinfo Solutions
- Worked on the systems study, understanding business flow on the client site.
- Designed, managed, and maintained the database in SQL Server 2000.
- Wrote stored procedures, views, indexes, triggers stored procedures, and functions in SQL Server 2000. Developed DTS packages for importing and exporting data from multiple sources.
- Designed the CRM software using VB, VC++ and Form Designer (company proprietary tool) and SQL Server 2000 according to customer requirement.
Technologies: SQL Server 2000, C++, Database Development, Relational Databases, MySQL, Microsoft Access
Experience
Real-time Analytics and Data Warehouse
Design and development of a real-time analytics system and data warehouse platform for statistical process control (SPC) software that is the #1 choice of the world's leading companies, delivering manufacturing analytics to the right people at the right time.
Technologies: Azure Event Hub, Azure Data Warehouse, SSIS, PowerBI, Azure Functions
Technologies: Azure Event Hub, Azure Data Warehouse, SSIS, PowerBI, Azure Functions
Energy Data Warehouse
Development and design of a data warehouse and reporting application to show historical reports to clients. It includes importing data from multiple sources using SSIS and Informatica, and creating a SSAS tabular model for data analysis and reporting.
Technologies: SQL Server 2012, SSIS, Informatica, SSAS, SSRS, SQL Sentry
Technologies: SQL Server 2012, SSIS, Informatica, SSAS, SSRS, SQL Sentry
Online Gaming Platform
Development and design of a gaming platform. It is a 24/7 online system allowing the user to play online casino games. The database design involves the design of how the transaction will be maintained in the system and how data from multiple casinos will save in the data warehouse for MIS and reporting purposes.
Technologies: SQL server 2008 R2, SSIS, Hadoop, SQL Sentry, Red Gate SQL Toolbelt, and LiteSpeed.
Technologies: SQL server 2008 R2, SSIS, Hadoop, SQL Sentry, Red Gate SQL Toolbelt, and LiteSpeed.
Education
2001 - 2005
Bachelor of Engineering Degree in Information Technology
Dronacharya College of Engineering - Gurgaon, India
Certifications
MARCH 2023 - MARCH 2025
Databricks Certified Data Engineer Associate
Databricks
JANUARY 2023 - JANUARY 2025
SnowPro Core Certification
Snowflake
DECEMBER 2019 - DECEMBER 2023
Microsoft Azure Data Engineer Associate
Microsoft
JANUARY 2016 - PRESENT
MongoDB SI Architect Certification
MongoDB University
APRIL 2012 - PRESENT
Microsoft Certified Professional
Microsoft
Skills
Languages
Python, SQL, Snowflake, Visual Basic 6 (VB6), Visual Basic for Applications (VBA), C++, JavaScript
Tools
Microsoft Power BI, Microsoft Access, Erwin, Microsoft Visual C++
Paradigms
Business Intelligence (BI), ETL, Database Development, Database Design
Platforms
Azure, Databricks, Azure PaaS, Kubernetes, Amazon Web Services (AWS), Azure Synapse, Azure Functions, Azure Event Hubs
Storage
Database Architecture, Database Administration (DBA), Azure SQL Databases, Relational Databases, Microsoft SQL Server, SQL Server Integration Services (SSIS), NoSQL, SQL Stored Procedures, MySQL, Data Lakes, Azure SQL, Azure Cosmos DB, Master Data Management (MDM), Data Pipelines, SQL Server 2016, SQL Server 2000, SQL Server 2005, SQL Server Reporting Services (SSRS), SQL Server Analysis Services (SSAS), Data Integration, MongoDB, SQL Performance
Industry Expertise
Accounting
Other
Data Warehousing, Data Engineering, Data Warehouse Design, Azure Data Factory, Big Data, Data Analysis, Azure Databricks, Optimization, PL/SQL Tuning, BI Reporting, Azure Data Lake, Data Modeling, Data Management, Data Build Tool (dbt), ELT, Real-time Data, Data Processing, Architecture, Back-end, Cloud Infrastructure, Data-level Security, Infrastructure, Business, Performance Tuning, Information Technology, Data Analytics, erwin Data Modeler, Analytics, Dashboards, Data Visualization, Data, Machine Learning
Frameworks
Windows PowerShell, Realtime, Spark
Libraries/APIs
PySpark
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring