Shashank is available for hire

Shashank Ranadive

Verified Expert in Engineering

Data Engineer and Software Developer

Location

Mississauga, ON, Canada

Toptal Member Since

October 4, 2021

Shashank is a results-oriented data and business intelligence professional with 20+ years of experience and a consistent track record delivering enterprise-scale data platforms and BI solutions. In the last five years, he worked as a lead architect, designer, and lead developer to architect, design and build several BI solutions for provincial government using Microsoft cloud-based advanced analytics stack.

Data Warehouse Design Data Engineering Azure Data Lake Microsoft Excel SQL Business Intelligence (BI)Python SQL Server BI REST APIs Azure SQL Databases Microsoft Power BI Git Databricks SQL Server 2016 Data Analytics Azure Synapse

Portfolio

Labor and Transportation Cluster, Government of Ontario

Python, Databricks, Azure, Azure Synapse, Azure SQL Databases, Azure Data Lake...

Microsoft

Azure, Azure SQL Databases, Azure Data Lake, Azure Data Factory...

Microsoft

SQL Server BI, C#, Data Analytics, ETL, Data Modeling, Database Modeling...

Experience

Python - 7 years SQL Server BI - 7 years Azure Data Lake - 6 years Azure SQL Databases - 6 years Microsoft Power BI - 5 years Azure Data Factory - 5 years Azure Synapse - 5 years Databricks - 4 years

Availability

Part-time

Preferred Environment

Windows, Linux, Python, SQL, Databricks, Microsoft Power BI, Azure Data Factory, Azure Synapse, Azure SQL Databases, Azure Data Lake

The most amazing...

...thing I've architected, designed, and built is a real-time telemetry analytics product that has both big and fast data characteristics.

Work Experience

Lead Data Engineer

2015 - PRESENT

Labor and Transportation Cluster, Government of Ontario

Delivered data platform and BI solutions based on Microsoft's advanced analytics stack and Databricks.
Architected, designed, and built Azure Storage, Azure Data Lake, Azure SQL DB, and Synapse-based data store that hosts large complex and diverse datasets for advanced data analytics.
Architected, designed, and built data pipelines in Databricks that handle a variety of data including big data in order of terabytes as well as high-velocity telemetry data.
Managed the DevOps activities of productions data pipelines. Performed Azure Datastore and self-serve analytics store optimization, managed Power BI premium capacity node administration.

Technologies: Python, Databricks, Azure, Azure Synapse, Azure SQL Databases, Azure Data Lake, Azure Data Factory, ETL, ELT, Data Modeling, Database Modeling, Architecture, Cloud, Data Pipelines, Data Scraping, SQL Server DBA, Microsoft SQL Server, Performance Tuning, Database Replication, Data Science, Machine Learning, Data Warehousing, SQL, DB, ETL Development, APIs, API Architecture, XML, Big Data, PySpark, SQL Server 2016, Data Visualization, Spark, Snowflake, Tableau, Business Intelligence (BI), Data Architecture, Informatica, Relational Database Design, Business Intelligence (BI) Platforms, Data Build Tool (dbt), Git, Data Warehouse Design, Microsoft Excel, REST APIs

Technology Strategist

2014 - 2015

Microsoft

Engaged CxO-level executives, technical decision-makers, and architects at Microsoft partners and customers to drive enterprise strategy, solution delivery, and managed services built on top of Microsoft Azure.
Provided enterprise-level strategic advice and architecture expertise to partners and customers, including architectural workshops, proofs of concept, and technical design sessions.
Mentored partner technical teams in architecting large-scale distributed systems and providing best practice guidance over the lifecycle of a project.

Technologies: Azure, Azure SQL Databases, Azure Data Lake, Azure Data Factory, Azure Functions, Python, R, C#, Architecture, Data Engineering, Data Science, Machine Learning, Data Warehousing, SQL Server 2016, Data Visualization, Spark, Business Intelligence (BI), Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, .NET Core, Data Warehouse Design, Microsoft Excel, REST APIs

Technical Architect

2004 - 2014

Microsoft

Worked with the corporate BI team to design and deliver corporate BI initiatives that collected data across disparate sources and provided near real-time intelligence to marketing team strategy, planning, and optimization.
Built an analytics platform to help marketers measure ROI of their various web and offline initiatives to drive the reduced cost per customer acquisition and engagement while improving the effectiveness of marketing campaigns.
Architected and built data warehouse and BI platform to drive predictable operational excellence and measurable business performance thru data-driven revenue forecasting, sales pipeline management, and quota management.

Technologies: SQL Server BI, C#, Data Analytics, ETL, Data Modeling, Database Modeling, Architecture, SQL Server DBA, Microsoft SQL Server, Performance Tuning, Data Warehousing, SQL, DB, ETL Development, Marketo, Google Analytics, APIs, API Architecture, JavaScript, XML, SQL Server 2016, Business Intelligence (BI), Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, Data Warehouse Design, Microsoft Excel, REST APIs

Architect

2003 - 2004

Avanade

Acted as a lead architect to deliver the integration platform of a billing system for a utility company.
This integration platform was developed using Microsoft BizTalk 2004.
Managed a team of six team members through project delivery.

Technologies: SQL Server BI, C#, SQL Server Integration Services (SSIS), BizTalk Server, Architecture, Data Architecture, Relational Database Design, Microsoft Excel

Development Lead

1999 - 2003

BMO Bank of Montreal

Acted as a development project lead on various enterprise-level IT projects to support business initiatives.
Delivered technical architecture and data models that meet key business objectives. Performed database and solution tuning effort for optimal performance for critical production systems.
Designed and developed batch processes to perform extract, transform, and load data across various systems.
Managed Agile delivery of solutions with project teams ranging from four team members to eight team members.

Technologies: C#, SQL Server BI, Oracle, Sybase, ETL, Data Modeling, Database Modeling, Architecture, Relational Database Design

Experience

Collision Analytics and Reporting

• Architected, designed, and built Azure Storage, Azure Data Lake, and Azure SQL DB-based data store that hosts large complex and diverse datasets for advanced data analytics.
• Architected, designed, and currently building Azure Databricks-based pipeline that retrieves near real-time collision data from SFTP server to build an Azure Databricks Delta Lake hosted with Azure Data Lake and Azure SQL DB.
• Designed an Azure Analytics Services-based analytics data store that retrieves data from Databricks Delta Lake for self-service analytics using Power BI.
• Guided the analytics development resources to build complex custom Power BI reports and dashboards as per business requirements.
• Guided the analytics development resources on best practices with code development and DevOps practices.

Maintenance of a Data Cloud-automated Vehicle Locator

• Architected, designed, and built Azure Storage, Azure Data Lake-based data store that hosts large telemetry datasets for advanced data analytics.
• Architected, designed, and built Azure Databricks-based pipeline that retrieves near real-time telemetry data across multiple Azure Blob storages and built a Databricks Delta Lake hosted with Azure Data Lake.
• Architected and designed an Azure Analytics Services-based data store that retrieves data from Databricks Delta Lake for self-service analytics using Power BI.
• Guided the analytics development resources on best practices with code development and DevOps practices.

407 TOVO Datastore

• Played advisory role for designing Azure Synapse-based 407 TOVO datastore.
• As a lead data engineer, managed all the enhancements and DevOps activities of productions system including Azure function and Azure Logic App-based data pipelines, Azure Synapse based datastore optimization, Azure Analysis service-based self-serve analytics store optimization, and Power BI workspace administration.
• Built complex custom Power BI reports and dashboards as per business requirements.
• Advised and mentored business users to enable them to perform self-service analytics using Power BI.
• Designed and delivered proposed architecture and delivery roadmap for the next phase of the product to migrate legacy on-premise capabilities with current cloud-based capabilities.

Ontario Together

• Architected, designed, and built a CDM datastore that received real-time data from CRM system holding supply chain data supporting Ontario’s multi-ministry initiative to support COVID-19 pandemic response.
• Architected, designed, and built Azure Databricks-based pipeline that retrieves near real-time CRM and Google Analytics data to build a Databricks-based data pipeline.
• Architected, designed, and built Azure Storage, Azure Data Lake, and Azure SQL Analysis Services-based data store that hosts high-performance datasets for self-service data analytics.
• Consulted and advised the GSIC team on building organizational data management architecture in collaboration with the ITS architecture team.
• Guided the analytics development resources on best practices with code development and DevOps practices.

Fleet Management Analytics

• Designed and built Azure SQL DB and Azure Analytics Services-based data analytics store that provides advanced row-level data filtering based on user roles using complex DAX-based real-time filtering.
• Designed and built Azure function apps based Azure Automation Services based data pipeline that loads data to Analytics data store.
• Guided the analytics development resources on best practices with code development and DevOps practices.

Telematics Realtime Dashboard

• Designed and build a data pipeline that retrieves real-time data from external service API, performed just-in-time transformation using Azure Data Factory, Azure Function apps, and Azure streaming services to post data for analytics consumption.
• Designed and built Power BI-based real-time dashboards that showed the latest location and telemetry of various managed vehicle assets across Ontario Highway Network.

Skills

Languages

Python, SQL, R, C#, XML, JavaScript, Snowflake

Libraries/APIs

REST APIs, Google Analytics API, PySpark

Tools

Microsoft Power BI, SQL Server BI, Git, Microsoft Excel, Google Analytics, Tableau

Paradigms

Business Intelligence (BI), Data Science, ETL, API Architecture

Platforms

Databricks, Azure Synapse, Azure Functions, Azure, Windows, Linux, Oracle, Marketo

Storage

Azure SQL Databases, SQL Server 2016, SQL Server Integration Services (SSIS), Sybase, Database Modeling, Data Pipelines, SQL Server DBA, Microsoft SQL Server, Database Replication, DB

Other

Azure Data Factory, Azure Data Lake, Data Engineering, Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, Data Warehouse Design, Data Analysis, Machine Learning, Data Analytics, Data Visualization, Streaming, Programming, Deep Learning, BizTalk Server, Azure Analysis Services, Common Data Service, ELT, Data Modeling, Architecture, Cloud, Data Scraping, Performance Tuning, Data Warehousing, ETL Development, APIs, Big Data, Informatica, Data Build Tool (dbt)

Frameworks

.NET Core, Hadoop, Spark

Education

1987 - 1991

Bachelor of Engineering Degree in Computer Science

University of Mumbai - Mumbai, India

edX

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring