Lead Data Engineer
2015 - PRESENTLabor and Transportation Cluster, Government of Ontario- Delivered data platform and BI solutions based on Microsoft's advanced analytics stack and Databricks.
- Architected, designed, and built Azure Storage, Azure Data Lake, Azure SQL DB, and Synapse-based data store that hosts large complex and diverse datasets for advanced data analytics.
- Architected, designed, and built data pipelines in Databricks that handle a variety of data including big data in order of terabytes as well as high-velocity telemetry data.
- Managed the DevOps activities of productions data pipelines. Performed Azure Datastore and self-serve analytics store optimization, managed Power BI premium capacity node administration.
Technologies: Python, Databricks, Azure, Azure Synapse, Azure SQL Databases, Azure Data Lake, Azure Data Factory, ETL, ELT, Data Modeling, Database Modeling, Architecture, Cloud, Data Pipelines, Data Scraping, SQL Server DBA, Microsoft SQL Server, Performance Tuning, Database Replication, Data Science, Machine Learning, Data Warehousing, SQL, DB, ETL Development, APIs, API Architecture, XML, Big Data, PySpark, SQL Server 2016, Data Visualization, Spark, Snowflake, Tableau, Business Intelligence (BI), Data Architecture, Informatica, Relational Database Design, Business Intelligence (BI) Platforms, Data Building Tool (DBT), Git, Data Warehouse Design, Microsoft Excel, REST APIsTechnology Strategist
2014 - 2015Microsoft- Engaged CxO-level executives, technical decision-makers, and architects at Microsoft partners and customers to drive enterprise strategy, solution delivery, and managed services built on top of Microsoft Azure.
- Provided enterprise-level strategic advice and architecture expertise to partners and customers, including architectural workshops, proofs of concept, and technical design sessions.
- Mentored partner technical teams in architecting large-scale distributed systems and providing best practice guidance over the lifecycle of a project.
Technologies: Azure, Azure SQL Databases, Azure Data Lake, Azure Data Factory, Azure Functions, Python, R, C#, Architecture, Data Engineering, Data Science, Machine Learning, Data Warehousing, SQL Server 2016, Data Visualization, Spark, Business Intelligence (BI), Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, .NET Core, Data Warehouse Design, Microsoft Excel, REST APIsTechnical Architect
2004 - 2014Microsoft- Worked with the corporate BI team to design and deliver corporate BI initiatives that collected data across disparate sources and provided near real-time intelligence to marketing team strategy, planning, and optimization.
- Built an analytics platform to help marketers measure ROI of their various web and offline initiatives to drive the reduced cost per customer acquisition and engagement while improving the effectiveness of marketing campaigns.
- Architected and built data warehouse and BI platform to drive predictable operational excellence and measurable business performance thru data-driven revenue forecasting, sales pipeline management, and quota management.
Technologies: SQL Server BI, C#, Data Analytics, ETL, Data Modeling, Database Modeling, Architecture, SQL Server DBA, Microsoft SQL Server, Performance Tuning, Data Warehousing, SQL, DB, ETL Development, Marketo, Google Analytics, APIs, API Architecture, JavaScript, XML, SQL Server 2016, Business Intelligence (BI), Data Architecture, Relational Database Design, Business Intelligence (BI) Platforms, Data Warehouse Design, Microsoft Excel, REST APIsArchitect
2003 - 2004Avanade- Acted as a lead architect to deliver the integration platform of a billing system for a utility company.
- This integration platform was developed using Microsoft BizTalk 2004.
- Managed a team of six team members through project delivery.
Technologies: SQL Server BI, C#, SQL Server Integration Services (SSIS), BizTalk Server, Architecture, Data Architecture, Relational Database Design, Microsoft ExcelDevelopment Lead
1999 - 2003BMO Bank of Montreal- Acted as a development project lead on various enterprise-level IT projects to support business initiatives.
- Delivered technical architecture and data models that meet key business objectives. Performed database and solution tuning effort for optimal performance for critical production systems.
- Designed and developed batch processes to perform extract, transform, and load data across various systems.
- Managed Agile delivery of solutions with project teams ranging from four team members to eight team members.
Technologies: C#, SQL Server BI, Oracle, Sybase, ETL, Data Modeling, Database Modeling, Architecture, Relational Database Design