Shashank is available for hire
Hire ShashankShashank Ranadive
Verified Expert in Engineering
Data Engineer and Software Developer
Mississauga, ON, Canada
Toptal member since October 4, 2021
Bio
Shashank is a results-oriented data and business intelligence professional with 20+ years of experience and a consistent track record delivering enterprise-scale data platforms and BI solutions. In the last five years, he worked as a lead architect, designer, and lead developer to architect, design and build several BI solutions for provincial government using Microsoft cloud-based advanced analytics stack.
Portfolio
Labor and Transportation Cluster, Government of Ontario
Python, Databricks, Azure, Azure Synapse, Azure SQL Databases, Azure Data Lake...
Microsoft
Azure, Azure SQL Databases, Azure Data Lake, Azure Data Factory (ADF)...
Microsoft
SQL Server BI, C#, Data Analytics, ETL, Data Modeling, Database Modeling...
Experience
- SQL Server BI - 7 years
- Python - 7 years
- Azure Data Lake - 7 years
- Azure SQL Databases - 6 years
- Microsoft Power BI - 5 years
- Azure Data Factory (ADF) - 5 years
- Azure Synapse - 5 years
- Databricks - 4 years
Preferred Environment
Windows, Linux, Python, SQL, Databricks, Microsoft Power BI, Azure Data Factory (ADF), Azure Synapse, Azure SQL Databases, Azure Data Lake
The most amazing...
...thing I've architected, designed, and built is a real-time telemetry analytics product that has both big and fast data characteristics.
Work Experience
Lead Data Engineer
2015 - PRESENT
Labor and Transportation Cluster, Government of Ontario
- Delivered data platform and BI solutions based on Microsoft's advanced analytics stack and Databricks.
- Architected, designed, and built Azure Storage, Azure Data Lake, Azure SQL DB, and Synapse-based data store that hosts large complex and diverse datasets for advanced data analytics.
- Architected, designed, and built data pipelines in Databricks that handle a variety of data including big data in order of terabytes as well as high-velocity telemetry data.
- Managed the DevOps activities of productions data pipelines. Performed Azure Datastore and self-serve analytics store optimization, managed Power BI premium capacity node administration.
Technologies: Python, Databricks, Azure, Azure Synapse, Azure SQL Databases, Azure Data Lake, Azure Data Factory (ADF), ETL, ELT, Data Modeling, Database Modeling, Architecture, Cloud, Data Pipelines, Data Scraping, SQL Server DBA, Microsoft SQL Server, Performance Tuning, Database Replication, Data Science, Machine Learning, Data Warehousing, SQL, DB, ETL Development, APIs, API Architecture, XML, Big Data, PySpark, SQL Server 2016, Data Visualization, Spark, Snowflake, Tableau, Business Intelligence (BI), Data Architecture, Informatica, Relational Database Design, Business Intelligence (BI) Platforms, Data Build Tool (dbt), Git, Data Warehouse Design, Microsoft Excel, REST APIs, Unity Catalog, Delta Lake, Data Management Platforms, Azure Data Lake Storage, Azure Service Fabric, Power BI REST APIs, Microsoft Fabric, Data Lakehouse, Data Lake Design, Database Architecture, NoSQL, Data Processing, Apache Spark, Research, Analytics, Technical Consulting, Data Lakes, Data Governance, Solution Architecture, Cloud Services, Azure Databricks
Technology Strategist
2014 - 2015
Microsoft
- Engaged CxO-level executives, technical decision-makers, and architects at Microsoft partners and customers to drive enterprise strategy, solution delivery, and managed services built on top of Microsoft Azure.
- Provided enterprise-level strategic advice and architecture expertise to partners and customers, including architectural workshops, proofs of concept, and technical design sessions.
- Mentored partner technical teams in architecting large-scale distributed systems and providing best practice guidance over the lifecycle of a project.
Technologies: Azure, Azure SQL Databases, Azure Data Lake, Azure Data Factory (ADF), Azure Functions, Python, R, C#, Architecture, Data Engineering, Data Science, Machine Learning, Data Warehousing, SQL Server 2016, Data Visualization, Spark, Business Intelligence (BI), Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, .NET Core, Data Warehouse Design, Microsoft Excel, REST APIs, Data Management Platforms, Azure Data Lake Storage, Amazon S3 (AWS S3), Research, Technical Sales, Presales, Solution Architecture, Insurance, Cloud Services, Azure Databricks
Technical Architect
2004 - 2014
Microsoft
- Worked with the corporate BI team to design and deliver corporate BI initiatives that collected data across disparate sources and provided near real-time intelligence to marketing team strategy, planning, and optimization.
- Built an analytics platform to help marketers measure ROI of their various web and offline initiatives to drive the reduced cost per customer acquisition and engagement while improving the effectiveness of marketing campaigns.
- Architected and built data warehouse and BI platform to drive predictable operational excellence and measurable business performance thru data-driven revenue forecasting, sales pipeline management, and quota management.
Technologies: SQL Server BI, C#, Data Analytics, ETL, Data Modeling, Database Modeling, Architecture, SQL Server DBA, Microsoft SQL Server, Performance Tuning, Data Warehousing, SQL, DB, ETL Development, Marketo, Google Analytics, APIs, API Architecture, JavaScript, XML, SQL Server 2016, Business Intelligence (BI), Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, Data Warehouse Design, Microsoft Excel, REST APIs, Customer Segmentation, Email Marketing, Data Management Platforms, Marketing, Database Architecture, Data Processing, Research, Analytics, Technical Sales, Solution Architecture
Architect
2003 - 2004
Avanade
- Acted as a lead architect to deliver the integration platform of a billing system for a utility company.
- This integration platform was developed using Microsoft BizTalk 2004.
- Managed a team of six team members through project delivery.
Technologies: SQL Server BI, C#, SQL Server Integration Services (SSIS), BizTalk Server, Architecture, Data Architecture, Relational Database Design, Microsoft Excel, Database Architecture
Development Lead
1999 - 2003
BMO Bank of Montreal
- Acted as a development project lead on various enterprise-level IT projects to support business initiatives.
- Delivered technical architecture and data models that meet key business objectives. Performed database and solution tuning effort for optimal performance for critical production systems.
- Designed and developed batch processes to perform extract, transform, and load data across various systems.
- Managed Agile delivery of solutions with project teams ranging from four team members to eight team members.
Technologies: C#, SQL Server BI, Oracle, Sybase, ETL, Data Modeling, Database Modeling, Architecture, Relational Database Design, Database Architecture, Finance, Financial Services
Experience
Collision Analytics and Reporting
• Architected, designed, and built Azure Storage, Azure Data Lake, and Azure SQL DB-based data store that hosts large complex and diverse datasets for advanced data analytics.
• Architected, designed, and currently building Azure Databricks-based pipeline that retrieves near real-time collision data from SFTP server to build an Azure Databricks Delta Lake hosted with Azure Data Lake and Azure SQL DB.
• Designed an Azure Analytics Services-based analytics data store that retrieves data from Databricks Delta Lake for self-service analytics using Power BI.
• Guided the analytics development resources to build complex custom Power BI reports and dashboards as per business requirements.
• Guided the analytics development resources on best practices with code development and DevOps practices.
• Architected, designed, and currently building Azure Databricks-based pipeline that retrieves near real-time collision data from SFTP server to build an Azure Databricks Delta Lake hosted with Azure Data Lake and Azure SQL DB.
• Designed an Azure Analytics Services-based analytics data store that retrieves data from Databricks Delta Lake for self-service analytics using Power BI.
• Guided the analytics development resources to build complex custom Power BI reports and dashboards as per business requirements.
• Guided the analytics development resources on best practices with code development and DevOps practices.
Maintenance of a Data Cloud-automated Vehicle Locator
• Architected, designed, and built Azure Storage, Azure Data Lake-based data store that hosts large telemetry datasets for advanced data analytics.
• Architected, designed, and built Azure Databricks-based pipeline that retrieves near real-time telemetry data across multiple Azure Blob storages and built a Databricks Delta Lake hosted with Azure Data Lake.
• Architected and designed an Azure Analytics Services-based data store that retrieves data from Databricks Delta Lake for self-service analytics using Power BI.
• Guided the analytics development resources on best practices with code development and DevOps practices.
• Architected, designed, and built Azure Databricks-based pipeline that retrieves near real-time telemetry data across multiple Azure Blob storages and built a Databricks Delta Lake hosted with Azure Data Lake.
• Architected and designed an Azure Analytics Services-based data store that retrieves data from Databricks Delta Lake for self-service analytics using Power BI.
• Guided the analytics development resources on best practices with code development and DevOps practices.
407 TOVO Datastore
• Played advisory role for designing Azure Synapse-based 407 TOVO datastore.
• As a lead data engineer, managed all the enhancements and DevOps activities of productions system including Azure function and Azure Logic App-based data pipelines, Azure Synapse based datastore optimization, Azure Analysis service-based self-serve analytics store optimization, and Power BI workspace administration.
• Built complex custom Power BI reports and dashboards as per business requirements.
• Advised and mentored business users to enable them to perform self-service analytics using Power BI.
• Designed and delivered proposed architecture and delivery roadmap for the next phase of the product to migrate legacy on-premise capabilities with current cloud-based capabilities.
• As a lead data engineer, managed all the enhancements and DevOps activities of productions system including Azure function and Azure Logic App-based data pipelines, Azure Synapse based datastore optimization, Azure Analysis service-based self-serve analytics store optimization, and Power BI workspace administration.
• Built complex custom Power BI reports and dashboards as per business requirements.
• Advised and mentored business users to enable them to perform self-service analytics using Power BI.
• Designed and delivered proposed architecture and delivery roadmap for the next phase of the product to migrate legacy on-premise capabilities with current cloud-based capabilities.
Ontario Together
• Architected, designed, and built a CDM datastore that received real-time data from CRM system holding supply chain data supporting Ontario’s multi-ministry initiative to support COVID-19 pandemic response.
• Architected, designed, and built Azure Databricks-based pipeline that retrieves near real-time CRM and Google Analytics data to build a Databricks-based data pipeline.
• Architected, designed, and built Azure Storage, Azure Data Lake, and Azure SQL Analysis Services-based data store that hosts high-performance datasets for self-service data analytics.
• Consulted and advised the GSIC team on building organizational data management architecture in collaboration with the ITS architecture team.
• Guided the analytics development resources on best practices with code development and DevOps practices.
• Architected, designed, and built Azure Databricks-based pipeline that retrieves near real-time CRM and Google Analytics data to build a Databricks-based data pipeline.
• Architected, designed, and built Azure Storage, Azure Data Lake, and Azure SQL Analysis Services-based data store that hosts high-performance datasets for self-service data analytics.
• Consulted and advised the GSIC team on building organizational data management architecture in collaboration with the ITS architecture team.
• Guided the analytics development resources on best practices with code development and DevOps practices.
Fleet Management Analytics
• Designed and built Azure SQL DB and Azure Analytics Services-based data analytics store that provides advanced row-level data filtering based on user roles using complex DAX-based real-time filtering.
• Designed and built Azure function apps based Azure Automation Services based data pipeline that loads data to Analytics data store.
• Guided the analytics development resources on best practices with code development and DevOps practices.
• Designed and built Azure function apps based Azure Automation Services based data pipeline that loads data to Analytics data store.
• Guided the analytics development resources on best practices with code development and DevOps practices.
Telematics Realtime Dashboard
• Designed and build a data pipeline that retrieves real-time data from external service API, performed just-in-time transformation using Azure Data Factory, Azure Function apps, and Azure streaming services to post data for analytics consumption.
• Designed and built Power BI-based real-time dashboards that showed the latest location and telemetry of various managed vehicle assets across Ontario Highway Network.
• Designed and built Power BI-based real-time dashboards that showed the latest location and telemetry of various managed vehicle assets across Ontario Highway Network.
Education
1987 - 1991
Bachelor of Engineering Degree in Computer Science
University of Mumbai - Mumbai, India
Certifications
SEPTEMBER 2017 - PRESENT
DS236X | Deep Learning Explained
edX
APRIL 2017 - PRESENT
DAT102x | Data Science Professional Project
edX
MARCH 2017 - PRESENT
DAT203.3x | Applied Machine Learning
edX
MARCH 2017 - PRESENT
DAT210x | Programming with Python for Data Science
edX
MARCH 2017 - PRESENT
DAT203.2x | Principles of Machine Learning
edX
MARCH 2017 - PRESENT
DAT203.1x | Data Science Essentials
edX
MARCH 2017 - PRESENT
DAT208x | Introduction to Python for Data Science
edX
MARCH 2017 - PRESENT
DAT101x | Data Science Orientation
edX
MARCH 2017 - PRESENT
DS101X | Statistical Thinking for Data Science and Analytics
edX
MARCH 2017 - PRESENT
DAT206x | Analyzing and Visualizing Data with Excel
edX
MARCH 2017 - PRESENT
DAT201x | Querying with Transact-SQL
edX
NOVEMBER 2015 - PRESENT
DAT202.2x | Implementing Real-Time Analytics with Hadoop in Azure HDInsight
edX
Skills
Libraries/APIs
REST APIs, Power BI REST APIs, Google Analytics API, PySpark
Tools
Microsoft Power BI, SQL Server BI, Git, Microsoft Excel, Google Analytics, Tableau
Languages
Python, SQL, Snowflake, R, C#, XML, JavaScript
Frameworks
Apache Spark, .NET Core, Data Lakehouse, Hadoop, Spark
Paradigms
ETL, Business Intelligence (BI), API Architecture
Platforms
Databricks, Azure Synapse, Azure Functions, Azure, Azure Data Lake Storage, Azure Service Fabric, Microsoft Fabric, Windows, Linux, Oracle, Marketo
Storage
Azure SQL Databases, SQL Server 2016, Database Architecture, Data Lakes, SQL Server Integration Services (SSIS), Microsoft SQL Server, Data Lake Design, Sybase, Database Modeling, Data Pipelines, SQL Server DBA, Database Replication, DB, Amazon S3 (AWS S3), NoSQL
Industry Expertise
Marketing, Insurance
Other
Azure Data Factory (ADF), Azure Data Lake, Data Engineering, Data Analytics, Big Data, Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, Data Warehouse Design, Data Processing, Analytics, Technical Consulting, Solution Architecture, Data Analysis, Data Science, Machine Learning, Cloud, Data Visualization, Streaming, Data Security, API Integration, Customer Segmentation, Email Marketing, Unity Catalog, Delta Lake, Data Management Platforms, Research, Technical Sales, Presales, Data Governance, Finance, Financial Services, Cloud Services, Azure Databricks, Programming, Deep Learning, BizTalk Server, Azure Analysis Services, Common Data Service, ELT, Data Modeling, Architecture, Data Scraping, Performance Tuning, Data Warehousing, ETL Development, APIs, Informatica, Data Build Tool (dbt)
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring