Mahalakshmi is currently unavailable
Mahalakshmi Srinivasan
Verified Expert in Engineering
Data Engineer and Developer
Abu Dhabi, United Arab Emirates
Toptal member since April 29, 2026
Bio
Mahalakshmi is a senior data engineer with 13 years of experience building and optimizing large-scale data pipelines and analytics solutions. She is proficient in PySpark, Databricks, Azure Data Factory, Informatica, and back-end systems such as Oracle, Teradata, and Delta Lake. Mahalakshmi is highly skilled in Python, Shell scripting, and automation to enhance performance, data quality, and operational efficiency.
Portfolio
Daman
Azure Databricks, PySpark, Python 3, Delta Lake, Informatica ETL, Oracle
Fidelity Investments
Azure Databricks, PySpark, Delta Lake, Azure Data Factory (ADF)...
Cognizant
Informatica ETL, Oracle, Teradata, Unix Shell Scripting, Autosys, Perl
Experience
- Oracle - 13 years
- Informatica ETL - 13 years
- Unix Shell Scripting - 9 years
- Azure Data Factory (ADF) - 5 years
- Python 3 - 5 years
- Delta Lake - 5 years
- Azure Databricks - 5 years
- PySpark - 5 years
Preferred Environment
PySpark, Delta Lake, Azure Databricks, PyCharm
The most amazing...
...thing I’ve developed is a scalable data platform that processed millions of records daily and improved reporting speed by 80%.
Work Experience
Senior Consultant
2025 - PRESENT
Daman
- Built high-performance ETL/ELT workflows using PySpark and cloud data platforms to process large-scale healthcare and insurance datasets. Optimized Spark jobs through partitioning and caching, significantly reducing processing time by 70%.
- Developed data quality and reconciliation frameworks to ensure accuracy, completeness, and consistency of claims and policy data, reducing the data quality issues by 90%.
- Implemented CI/CD and version control best practices for data pipelines using Git and DevOps tools. Mentored junior engineers, conducted code reviews, and enforced data engineering best practices and standards.
Technologies: Azure Databricks, PySpark, Python 3, Delta Lake, Informatica ETL, Oracle
Lead Software Engineer
2021 - 2025
Fidelity Investments
- Designed and implemented scalable PySpark ETL pipelines on Databricks to ingest and transform data from multiple sources. Optimized job performance using partitioning, bucketing, and Spark tuning, reducing runtime by 75% and costs by 50%.
- Built Delta Lake data models with ACID transactions, schema evolution, and time travel. Developed automated data quality frameworks in PySpark for schema validation and anomaly detection. Integrated Databricks with ADLS for Ingestion.
- Designed, implemented, and managed CI/CD pipelines using Azure DevOps for enterprise-scale applications. Handled source code management using Git, branching strategies, pull requests, and repository governance.
- Tuned PL/SQL queries and created packages, improving performance by 75%. Automated validations using Python, reducing manual effort by 90%.
- Led teams in Agile Scrum and mentored 10+ junior engineers.
- Received the Fidelity Chairman’s Share Award at Fidelity Investments for outstanding performance and business impact.
Technologies: Azure Databricks, PySpark, Delta Lake, Azure Data Factory (ADF), Azure SQL Databases, Informatica ETL, Oracle PL/SQL, Oracle 9g
Senior Associate
2012 - 2021
Cognizant
- Developed a generic framework using Unix shell scripting, adopted by multiple clients at Cognizant, and recognized with multiple awards. Automated data quality checks across multiple source and target systems, cutting manual validation effort by 70%.
- Led the delivery of commercial sales data warehouse systems for 5+ teams. Developed ETL pipelines with Informatica for diverse sources (flat files, Teradata, Oracle). Implemented SCD Types I, II, and III and validated ETL standards.
- Earned the Star Performer Award at Cognizant for 3 consecutive years in recognition of consistent high performance.
Technologies: Informatica ETL, Oracle, Teradata, Unix Shell Scripting, Autosys, Perl
Experience
Enterprise Data Platform Using Azure Databricks & Medallion Architecture
Designed and developed a scalable cloud data platform on Azure Databricks using Medallion Architecture (Bronze, Silver, Gold) to process millions of records from multiple source systems and deliver analytics-ready datasets.
KEY CONTRIBUTIONS
• Built PySpark ETL pipelines in Azure Databricks
• Implemented Bronze, Silver, and Gold layers using Delta Lake
• Optimized Spark jobs and reduced runtime by 60%
• Automated workflows using Databricks Jobs/ADF
• Enabled Power BI reporting with curated Gold tables
• Improved data quality and governance checks
IMPACT
Processed 10+ million daily records and improved reporting SLA by 50%.
KEY CONTRIBUTIONS
• Built PySpark ETL pipelines in Azure Databricks
• Implemented Bronze, Silver, and Gold layers using Delta Lake
• Optimized Spark jobs and reduced runtime by 60%
• Automated workflows using Databricks Jobs/ADF
• Enabled Power BI reporting with curated Gold tables
• Improved data quality and governance checks
IMPACT
Processed 10+ million daily records and improved reporting SLA by 50%.
Education
2008 - 2012
Bachelor's Degree in Electrical Engineering
Sri Sivasubramaniya Nadar College of Engineering - Tamil Nadu, India
Skills
Libraries/APIs
PySpark
Tools
Informatica ETL, Autosys, PyCharm, Git
Platforms
Oracle
Storage
Oracle 9g, Teradata, Azure SQL Databases, Oracle PL/SQL
Languages
Python 3, Perl, C++, SQL
Other
Delta Lake, Azure Databricks, Unix Shell Scripting, Azure Data Factory (ADF)
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring