
Harshad Saglani
Verified Expert in Engineering
Data Engineer and Developer
Pune, Maharashtra, India
Toptal member since September 13, 2022
Harshad has 20+ years of experience as a developer, data engineer, and solution architect specializing in cloud-based (Azure and AWS) enterprise software and data products. He also has 5+ years of experience as a data engineer and is an expert Python, SQL, Apache Spark, and Databricks developer.
Portfolio
Experience
- Oracle PL/SQL - 12 years
- SQL - 12 years
- Data Engineering - 4 years
- Data Warehousing - 3 years
- Python - 2 years
- Databricks - 1 year
- NoSQL - 1 year
- Apache Spark - 1 year
Availability
Preferred Environment
SQL, NoSQL, Apache Spark, Data Engineering, Data Warehousing, Python, ETL, Databricks, Azure, Data Migration
The most amazing...
...system I've developed checks the overall health of operational systems, uncovers system issues, and increases management's confidence in the reports.
Work Experience
Lead Data Engineer
Everest Group (Reinsurance) via Synechron
- Created data pipelines that consume raw data and harmonize, curate, and transform the data in different containers. Used Azure Databricks for data transformation.
- Managed the project's go-live activities and automated the reconciliations for data that moved through many systems.
- Worked as an owner of the client's accounting system that calculates the ceded premiums and losses for the reinsurance. Performed deployments, disaster recovery testing, and automated backup setups and created access management documents.
Developer | Odoo ERP (via Toptal)
Antibes Shipservices
- Created a custom app for Odoo ERP using Python, PostgreSQL, and Odoo ORM API. The client used this app to merge their products into product variants without losing original product IDs and historical data.
- Built a smart Excel sheet (using macros) for clients to quickly decide which products they want to merge.
- Developed the app that performed many validations before merging, automatically created required product attributes, and updated prices for variants based on differences in base product and variant.
Principal Architect
Majesco
- Developed the data product using MongoDB as a NoSQL database and Apache Spark to create operational reports data, replace Oracle-based reporting, and save more than 50% of customer costs on software licenses.
- Served as a product owner, delivering solutions, approaches, and significant enhancements to Majesco's flagship policy administration product to fulfill customer requirements. Provided consultations to the customer and implementation teams.
- Improved the policy administration product, including an automated transaction processor, operational data store, actuarial reporting, a data migration module, and API specifications for the entire product and integration with AssureSign.
- Built a data warehouse system that extracts data from the policy administration system and performs complex transformations for actuarial, statistical, and regulatory reporting.
- Developed a set of utilities that checks the overall health of the operational systems, uncovers the system issues, and helps management reconcile report data from various departments and have more confidence in the summary reports.
- Served as a product owner of a very large system, responsible for the quality and on-time delivery of product features each month. This included managing the product roadmap from the product manager and serving the sales and implementation teams.
- Managed the product QA and development teams, coordinated the product release (DevOps) and documentation activities to ensure smooth releases to all customers, and interacted with customers to understand their concerns and needs.
Senior Architect
Cognizant
- Led the team that developed an Android mobile application for a major online bank in the United States.
- Developed the application's banking and credit card functionalities, including remote check deposits, statements, fund transfers, payments, promotions, and an ATM locator.
- Managed the development of the banking and credit card application for Android tablets.
Lead Consultant
Capgemini
- Gathered customer requirements and conducted feasibility analysis workshops for customers while serving as a functional lead.
- Managed the delivery of enhancements and maintenance releases for customers as a systems analyst for the customer service team.
- Worked as a senior developer for a customer's enterprise billing system in Oracle PL/SQL.
Software Engineer
STGIL (Acquired by Majesco)
- Developed new product modules, such as document generation, printing, and surcharge ratings.
- Led product implementations on-site for customers in the United States.
- Performed research and development for new product features. Designed and implemented the product health check tool and dependency matrix tool.
- Created the data migration and data generation modules to load transactions from external or legacy systems into the policy administration system.
Experience
Report Reconciliation Utility
The data for these reports came from multiple systems, and summary reports didn't match exactly with the operational reports from those systems. The discrepancies were caused by differences such as using effective dates versus calendar dates, back-dated transactions, and system bugs.
We needed all the reports to match to be confident that our reporting and operational systems were in good health. To accomplish this, I wrote many programs in Oracle PL/SQL that scanned the transactions from systems and compared them with the reporting data and vice versa.
This utility was a huge success and saved at least one week every month for 1-2 people who used to manually verify the discrepancies in the reports. This report also led to a high level of confidence in the system, continually uncovered system issues, and was very helpful in testing the overall health of the systems.
Data Engineering
https://github.com/harsag/hars-data-enggHandwritten Digit Classifier
https://github.com/harsag/hars-mnistThis project has a neural network (deep learning) model and a UI where users can draw a digit and see the result (prediction). I worked on this project to gain a working knowledge of developing and deploying a machine learning model and using it from a UI, data pipeline, or workflow.
Education
Bachelor's Degree in Computer Science and Engineering
Sant Gadge Baba Amravati University - Amravati, Maharashtra, India
Diploma in Electronics and Communication Engineering
Maharashtra State Board of Technical Education, Mumbai - Mumbai, Maharashtra, India
Certifications
Databricks Certified Associate Developer for Apache Spark 3.0 - Python
Databricks
Databricks Certified Data Engineer Associate
Databricks
Certified SAFe 5 Product Owner/Product Manager
Scaled Agile
Skills
Libraries/APIs
Pandas, PySpark
Tools
Boto 3, Odoo, Spark SQL, AWS Glue
Languages
SQL, Python 3, Python
Paradigms
Agile, Business Intelligence (BI), ETL, Management
Platforms
Oracle, Databricks, Amazon Web Services (AWS), Azure, Azure Synapse, AWS Lambda
Storage
Oracle PL/SQL, Databases, PostgreSQL, NoSQL, Data Pipelines, MongoDB, Microsoft SQL Server, Amazon S3 (AWS S3)
Frameworks
Apache Spark, Spark, Data Lakehouse, Adaptive Query Execution (AQE)
Other
Client Interaction, Computer Engineering, Computer Science, APIs, Integration, Data Engineering, Data Warehousing, ELT, Functional Requirements, Business Requirements, Dashboards, CRM APIs, Data Migration, System Requirements, Leadership, Product Management, Migration, Azure Databricks, Azure Data Factory (ADF), Azure Data Lake, Data Warehouse Design, Spark architecture
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring