toptal.com
Contact us: +1.888.867.7001
Shashank Ranadive, Data Engineer and Software Developer in Mississauga, ON, Canada
Shashank Ranadive

Data Engineer and Software Developer in Mississauga, ON, Canada

Member since October 4, 2021
Shashank is a results-oriented data and business intelligence professional with 20+ years of experience and a consistent track record delivering enterprise-scale data platforms and BI solutions. In the last five years, he worked as a lead architect, designer, and lead developer to architect, design and build several BI solutions for provincial government using Microsoft cloud-based advanced analytics stack.
Shashank is now available for hire
Hire Shashank

Portfolio

Experience

Location

Mississauga, ON, Canada

Availability

Part-time

Preferred Environment

Windows, Linux, Python, SQL, Databricks, Microsoft Power BI, Azure Data Factory, Azure Synapse, Azure SQL Databases, Azure Data Lake

The most amazing...

...thing I've architected, designed, and built is a real-time telemetry analytics product that has both big and fast data characteristics.

Employment

  • Lead Data Engineer

    2015 - PRESENT
    Labor and Transportation Cluster, Government of Ontario
    • Delivered data platform and BI solutions based on Microsoft's advanced analytics stack and Databricks.
    • Architected, designed, and built Azure Storage, Azure Data Lake, Azure SQL DB, and Synapse-based data store that hosts large complex and diverse datasets for advanced data analytics.
    • Architected, designed, and built data pipelines in Databricks that handle a variety of data including big data in order of terabytes as well as high-velocity telemetry data.
    • Managed the DevOps activities of productions data pipelines. Performed Azure Datastore and self-serve analytics store optimization, managed Power BI premium capacity node administration.
    Technologies: Python, Databricks, Azure, Azure Synapse, Azure SQL Databases, Azure Data Lake, Azure Data Factory, ETL, ELT, Data Modeling, Database Modeling, Architecture, Cloud, Data Pipelines, Data Scraping, SQL Server DBA, Microsoft SQL Server, Performance Tuning, Database Replication, Data Science, Machine Learning, Data Warehousing, SQL, DB, ETL Development, APIs, API Architecture, XML, Big Data, PySpark, SQL Server 2016, Data Visualization, Spark, Snowflake, Tableau, Business Intelligence (BI), Data Architecture, Informatica, Relational Database Design, Business Intelligence (BI) Platforms, Data Building Tool (DBT), Git, Data Warehouse Design, Microsoft Excel, REST APIs

  • Technology Strategist

    2014 - 2015
    Microsoft
    • Engaged CxO-level executives, technical decision-makers, and architects at Microsoft partners and customers to drive enterprise strategy, solution delivery, and managed services built on top of Microsoft Azure.
    • Provided enterprise-level strategic advice and architecture expertise to partners and customers, including architectural workshops, proofs of concept, and technical design sessions.
    • Mentored partner technical teams in architecting large-scale distributed systems and providing best practice guidance over the lifecycle of a project.
    Technologies: Azure, Azure SQL Databases, Azure Data Lake, Azure Data Factory, Azure Functions, Python, R, C#, Architecture, Data Engineering, Data Science, Machine Learning, Data Warehousing, SQL Server 2016, Data Visualization, Spark, Business Intelligence (BI), Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, .NET Core, Data Warehouse Design, Microsoft Excel, REST APIs

  • Technical Architect

    2004 - 2014
    Microsoft
    • Worked with the corporate BI team to design and deliver corporate BI initiatives that collected data across disparate sources and provided near real-time intelligence to marketing team strategy, planning, and optimization.
    • Built an analytics platform to help marketers measure ROI of their various web and offline initiatives to drive the reduced cost per customer acquisition and engagement while improving the effectiveness of marketing campaigns.
    • Architected and built data warehouse and BI platform to drive predictable operational excellence and measurable business performance thru data-driven revenue forecasting, sales pipeline management, and quota management.
    Technologies: SQL Server BI, C#, Data Analytics, ETL, Data Modeling, Database Modeling, Architecture, SQL Server DBA, Microsoft SQL Server, Performance Tuning, Data Warehousing, SQL, DB, ETL Development, Marketo, Google Analytics, APIs, API Architecture, JavaScript, XML, SQL Server 2016, Business Intelligence (BI), Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, Data Warehouse Design, Microsoft Excel, REST APIs

  • Architect

    2003 - 2004
    Avanade
    • Acted as a lead architect to deliver the integration platform of a billing system for a utility company.
    • This integration platform was developed using Microsoft BizTalk 2004.
    • Managed a team of six team members through project delivery.
    Technologies: SQL Server BI, C#, SQL Server Integration Services (SSIS), BizTalk Server, Architecture, Data Architecture, Relational Database Design, Microsoft Excel

  • Development Lead

    1999 - 2003
    BMO Bank of Montreal
    • Acted as a development project lead on various enterprise-level IT projects to support business initiatives.
    • Delivered technical architecture and data models that meet key business objectives. Performed database and solution tuning effort for optimal performance for critical production systems.
    • Designed and developed batch processes to perform extract, transform, and load data across various systems.
    • Managed Agile delivery of solutions with project teams ranging from four team members to eight team members.
    Technologies: C#, SQL Server BI, Oracle, Sybase, ETL, Data Modeling, Database Modeling, Architecture, Relational Database Design

Experience

  • Collision Analytics and Reporting

    • Architected, designed, and built Azure Storage, Azure Data Lake, and Azure SQL DB-based data store that hosts large complex and diverse datasets for advanced data analytics.
    • Architected, designed, and currently building Azure Databricks-based pipeline that retrieves near real-time collision data from SFTP server to build an Azure Databricks Delta Lake hosted with Azure Data Lake and Azure SQL DB.
    • Designed an Azure Analytics Services-based analytics data store that retrieves data from Databricks Delta Lake for self-service analytics using Power BI.
    • Guided the analytics development resources to build complex custom Power BI reports and dashboards as per business requirements.
    • Guided the analytics development resources on best practices with code development and DevOps practices.

  • Maintenance of a Data Cloud-automated Vehicle Locator

    • Architected, designed, and built Azure Storage, Azure Data Lake-based data store that hosts large telemetry datasets for advanced data analytics.
    • Architected, designed, and built Azure Databricks-based pipeline that retrieves near real-time telemetry data across multiple Azure Blob storages and built a Databricks Delta Lake hosted with Azure Data Lake.
    • Architected and designed an Azure Analytics Services-based data store that retrieves data from Databricks Delta Lake for self-service analytics using Power BI.
    • Guided the analytics development resources on best practices with code development and DevOps practices.

  • 407 TOVO Datastore

    • Played advisory role for designing Azure Synapse-based 407 TOVO datastore.
    • As a lead data engineer, managed all the enhancements and DevOps activities of productions system including Azure function and Azure Logic App-based data pipelines, Azure Synapse based datastore optimization, Azure Analysis service-based self-serve analytics store optimization, and Power BI workspace administration.
    • Built complex custom Power BI reports and dashboards as per business requirements.
    • Advised and mentored business users to enable them to perform self-service analytics using Power BI.
    • Designed and delivered proposed architecture and delivery roadmap for the next phase of the product to migrate legacy on-premise capabilities with current cloud-based capabilities.

  • Ontario Together

    • Architected, designed, and built a CDM datastore that received real-time data from CRM system holding supply chain data supporting Ontario’s multi-ministry initiative to support COVID-19 pandemic response.
    • Architected, designed, and built Azure Databricks-based pipeline that retrieves near real-time CRM and Google Analytics data to build a Databricks-based data pipeline.
    • Architected, designed, and built Azure Storage, Azure Data Lake, and Azure SQL Analysis Services-based data store that hosts high-performance datasets for self-service data analytics.
    • Consulted and advised the GSIC team on building organizational data management architecture in collaboration with the ITS architecture team.
    • Guided the analytics development resources on best practices with code development and DevOps practices.

  • Fleet Management Analytics

    • Designed and built Azure SQL DB and Azure Analytics Services-based data analytics store that provides advanced row-level data filtering based on user roles using complex DAX-based real-time filtering.
    • Designed and built Azure function apps based Azure Automation Services based data pipeline that loads data to Analytics data store.
    • Guided the analytics development resources on best practices with code development and DevOps practices.

  • Telematics Realtime Dashboard

    • Designed and build a data pipeline that retrieves real-time data from external service API, performed just-in-time transformation using Azure Data Factory, Azure Function apps, and Azure streaming services to post data for analytics consumption.
    • Designed and built Power BI-based real-time dashboards that showed the latest location and telemetry of various managed vehicle assets across Ontario Highway Network.

Skills

  • Languages

    Python, SQL, R, C#, XML, JavaScript, Snowflake

  • Libraries/APIs

    REST APIs, Google Analytics API, PySpark

  • Tools

    Microsoft Power BI, SQL Server BI, Git, Microsoft Excel, Google Analytics, Tableau

  • Paradigms

    Business Intelligence (BI), Data Science, ETL, API Architecture

  • Platforms

    Databricks, Azure Functions, Azure, Windows, Linux, Oracle, Marketo

  • Storage

    Azure SQL Databases, SQL Server 2016, SQL Server Integration Services (SSIS), Sybase, Database Modeling, Data Pipelines, SQL Server DBA, Microsoft SQL Server, Database Replication, DB

  • Other

    Azure Data Factory, Azure Synapse, Azure Data Lake, Data Engineering, Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, Data Warehouse Design, Data Analysis, Machine Learning, Data Analytics, Azure Streaming Services, Data Visualization, Programming, Deep Learning, BizTalk Server, Azure Analysis Services, Common Data Service, ELT, Data Modeling, Architecture, Cloud, Data Scraping, Performance Tuning, Data Warehousing, ETL Development, APIs, Big Data, Informatica, Data Building Tool (DBT)

  • Frameworks

    .NET Core, Hadoop, Spark

Education

  • Bachelor of Engineering Degree in Computer Science
    1987 - 1991
    University of Mumbai - Mumbai, India

Certifications

  • DS236X | Deep Learning Explained
    SEPTEMBER 2017 - PRESENT
    edX
  • DAT102x | Data Science Professional Project
    APRIL 2017 - PRESENT
    edX
  • DAT203.3x | Applied Machine Learning
    MARCH 2017 - PRESENT
    edX
  • DAT210x | Programming with Python for Data Science
    MARCH 2017 - PRESENT
    edX
  • DAT203.2x | Principles of Machine Learning
    MARCH 2017 - PRESENT
    edX
  • DAT203.1x | Data Science Essentials
    MARCH 2017 - PRESENT
    edX
  • DAT208x | Introduction to Python for Data Science
    MARCH 2017 - PRESENT
    edX
  • DAT101x | Data Science Orientation
    MARCH 2017 - PRESENT
    edX
  • DS101X | Statistical Thinking for Data Science and Analytics
    MARCH 2017 - PRESENT
    edX
  • DAT206x | Analyzing and Visualizing Data with Excel
    MARCH 2017 - PRESENT
    edX
  • DAT201x | Querying with Transact-SQL
    MARCH 2017 - PRESENT
    edX
  • DAT202.2x | Implementing Real-Time Analytics with Hadoop in Azure HDInsight
    NOVEMBER 2015 - PRESENT
    edX

To view more profiles

Join Toptal
Share it with others
Hire the top 3% of freelance developers TM