Edison is available for hire

Edison Zhu

Verified Expert in Engineering

Azure BI Developer

Location

Sydney, New South Wales, Australia

Toptal Member Since

July 7, 2021

Edison is an Azure BI developer, data engineer, and data architect with 18 years of BI and data engineering experience across industries. Backed by an MCSE Azure Cloud Platform certification, he delivers high-quality BI solutions using Azure Data Factory (ADF), Python, Azure Functions, Azure SQL Database, Azure Synapse, Power BI, Databricks, Analysis Service, and SQL Server. Edison also excels at dimensional modeling, performance turning large data warehouses, and .NET and Angular development.

Portfolio

Woolworths

Azure Synapse, Azure Analysis Services, Microsoft Power BI, Azure Data Factory...

Aerial Industries Pte. Ltd

Microsoft Access, JavaScript, Azure SQL, Angular, Angular Material, C#.NET...

Acumen Commercial Insights

Data Engineering, Azure Data Factory, XML, SQL, REST, ETL Tools, APIs...

Experience

ETL - 18 years SQL Server BI - 16 years Azure Data Factory - 9 years Azure SQL Databases - 9 years Microsoft Power BI - 8 years Azure Analysis Services - 6 years Azure Synapse - 5 years Python 3 - 3 years

Availability

Full-time

Preferred Environment

Azure PaaS, SQL Server BI, Windows 10, Visual Studio, Python 3, Microsoft Power BI, Azure Data Factory, Azure Functions, Tableau Desktop Pro, Google BigQuery

The most amazing...

...enterprise projects I've delivered end-to-end helped businesses make data-driven decisions and make business operations more efficient.

Work Experience

Senior Azure BI, Data Engineer, Power BI, Tableau, BigQuery, Python Developer

2020 - PRESENT

Woolworths

Designed and developed the online sales dashboard, store operation dashboard, point-to-point delivery dashboard, and product availability dashboards using Microsoft Power BI, Azure Synapse, Azure Analysis Services, and DAX.
Delivered the Data Factory ETL pipelines to dynamically copy data into Azure Blob Storage and load the dimension and fact tables.
Designed and developed the data warehouse, analysis service cube, ETL process, and dimensional modeling.
Migrated the seven existing fulfillment web reports of Woolworths' online sales to SSRS reports using Azure Synapse and SSRS.
Created Azure Functions to process XML messages with Python, Azure Service Bus, Cosmos DB, and Azure Storage Queue.
Developed point-to-point delivery and Online KPI Tableau dashboards using GCP BigQuery and Tableau.
Built a data ingestion pipeline with Python to integrate Google Sheet's data into GCP BigQuery and Storage Buckets.
Created the Azure Functions to create IotHub and Stream Analytics automatically.
Changed the Power Query to add the features to a Power BI report.

Technologies: Azure Synapse, Azure Analysis Services, Microsoft Power BI, Azure Data Factory, Tableau, Azure SQL Databases, Azure Logic Apps, Data Warehouse Design, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Data Engineering, SQL, Google BigQuery, DAX, Apache Airflow, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, APIs, Data Migration, API Connectors, ETL, XML, REST, ETL Tools, Business Intelligence (BI), Dashboards, Data Visualization, Pandas, Data Pipelines, Data Analytics, Data Lake Design, Data Lakes, Data, Cloud Platforms, Data Modeling, Data Analysis, Python 3, Azure Functions, SQL Server BI, Database Administration (DBA), SQL Server DBA, Azure Blobs, BigQuery, NoSQL, Webhooks, Power Query, ODBC, Microsoft Excel, OLTP, OLAP, Data Integration, Database Integration, Google Cloud Platform (GCP), Azure DevOps, ELT, BI Reporting, Excel 2010, SSRS Reports, Database Modeling, Minimum Viable Product (MVP), Consolidation, Stored Procedure, Cloud Migration, eCommerce, Looker, Jira, T-SQL (Transact-SQL), Azure SQL Data Warehouse, Dedicated SQL Pool (formerly SQL DW), Reporting, SAP, Data Cleansing, Data Quality Analysis, Database Migration, Google Data Studio, ETL Pipelines, Database Lifecycle Management (DLM), Cloud, Entity Relationships, Azure Databricks, SQL Stored Procedures, Performance Tuning, Data Management, Databricks, Data Feeds, Data Extraction, Delta Lake, .NET, C#, Architecture, Requirements Analysis, JSON

Database and Full-stack Developer

2023 - 2023

Aerial Industries Pte. Ltd

Reverse-engineered the existing Microsoft Access, including the tables, queries, and forms. Migrated all the tables from Microsoft Access to the Azure SQL database.
Developed the front end of the web app using Angular 16.
Built the REST API using C#, .NET Core, and Azure SQL database.

Technologies: Microsoft Access, JavaScript, Azure SQL, Angular, Angular Material, C#.NET, .NET Core, .NET, C#, Requirements Analysis

Azure Data Engineer

2022 - 2022

Acumen Commercial Insights

Delivered a data integration project in the retail FMCG industry.
Built an ADF pipeline, Azure Function, and C# Web API to integrate data—including invoice, sales, customer, product, and payment—from SAP IDoc XML, SFTP, and API to the Azure SQL Database.
Developed a Blob-triggered Azure Function for multiple clients to transform XML data—including XSD validation and XSLT transformation—generating an output file and sending it to the client by API.
Designed the pipeline to ingest Excel and CSV files into the integration database, transform the Excel data to unpivot the data, and export the data to clients using ADF data flows.

Technologies: Data Engineering, Azure Data Factory, XML, SQL, REST, ETL Tools, APIs, Azure Functions, ASP.NET Web API, Database Architecture, Webhooks, Microsoft Excel, Azure Queue Storage, Data Integration, Database Integration, HTML, Azure DevOps, Excel 2010, Database Modeling, Minimum Viable Product (MVP), Consolidation, Stored Procedure, Azure App Service, GitHub, Jira, T-SQL (Transact-SQL), SAP, Data Cleansing, Data Quality Analysis, Database Migration, ETL Pipelines, Database Lifecycle Management (DLM), Cloud, Entity Relationships, SQL Stored Procedures, Performance Tuning, Data Extraction, .NET, C#, Architecture, Requirements Analysis, JSON

Azure Data Engineer & Data Architect

2018 - 2020

Antares Solutions

Designed and developed the ETL, data warehouse, cube, and reports of a digital email campaign for a leading health supplement company. This automation saved the client a substantial amount of time.
Delivered a real-time big data analytics architecture, which included a real-time big data IoT, machine learning, and advanced analytics platform for a leading entertainment company.
Developed text classification for clients using Python, Keras, word embedding, NLP, Word2vec, GloVe, deep learning, and CNN.
Produced a movie recommendation proof of concept using Azure Databricks, machine learning, collaborative filtering, real-time data ingestion, Azure Event Hubs, Spark MLlib, and Python.
Created a data integration pipeline to ingest SAP IDoc XML data—including invoice, sales, customer, product, and payment—into the integration database using ADF, Azure SQL Database, and Azure Blob Storage.
Built a Blob-triggered Azure Function for multiple clients to transform XML data—including XSD validation and XSLT transformation—generating an output file and sending it to the client by API.

Technologies: Azure Data Factory, Databricks, Azure Analysis Services, Microsoft Power BI, SSRS Reports, SQL Server Integration Services (SSIS), Python, Azure Event Hubs, Azure Stream Analytics, Azure Logic Apps, GloVe, Generative Pre-trained Transformers (GPT), GPT, Natural Language Processing (NLP), Data Warehouse Design, Microsoft SQL Server, Data Architecture, SQL Server Analysis Services (SSAS), Data Engineering, SQL, DAX, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, Azure Machine Learning, APIs, Data Migration, API Connectors, ETL, XML, REST, ETL Tools, Business Intelligence (BI), Dashboards, Data Visualization, Pandas, Data Pipelines, Data Analytics, Marketing, PostgreSQL, Data Lake Design, Data Lakes, Data, Redshift, Cloud Platforms, Data Modeling, Data Analysis, Azure Functions, Azure SQL Databases, SQL Server BI, Database Administration (DBA), SQL Server DBA, Spark, Azure Blobs, Salesforce API, ASP.NET Web API, Database Architecture, BigQuery, NoSQL, Power Query, ODBC, JavaScript, Microsoft Excel, OLTP, OLAP, Snowflake, Data Integration, Database Integration, Web Scraping, Data Scraping, Scientific Data Analysis, Google Analytics, HTML, Azure DevOps, Apache Spark, ELT, BI Reporting, Excel 2010, Database Modeling, Minimum Viable Product (MVP), Consolidation, PL/SQL, Stored Procedure, Azure App Service, GitHub, Cloud Migration, eCommerce, Jira, T-SQL (Transact-SQL), Azure SQL Data Warehouse, Dedicated SQL Pool (formerly SQL DW), Reporting, Hadoop, Data Cleansing, Data Quality Analysis, Data Science, Database Migration, Big Data, ETL Pipelines, Database Lifecycle Management (DLM), Cloud, Entity Relationships, Amazon S3 (AWS S3), Azure Databricks, SQL Stored Procedures, Performance Tuning, Data Management, Data Feeds, Data Extraction, Delta Lake, Spark SQL, .NET, C#, Architecture, Requirements Analysis, JSON

Senior Azure BI Developer

2017 - 2018

Woolworths Group

Designed and built a dimensional modeling data warehouse, a tabular cube, and Power BI dashboard of online sales using Azure Data Warehouse, Azure Analysis Services cube, and Power BI.
Performance-tuned large volume data with table partition, cube partition, polybase, and hash distribution on Azure Data Warehouse.
Automated the cube process using Azure Automation account, runbooks, and webhooks.

Technologies: Azure Data Factory, Azure Synapse, Microsoft Power BI, Azure Analysis Services, Azure Logic Apps, Data Warehouse Design, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Data Engineering, SQL, DAX, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, Data Migration, ETL, ETL Tools, Business Intelligence (BI), Dashboards, Tableau, Data Visualization, Data Pipelines, Data Analytics, Data Lake Design, Data Lakes, Data, Cloud Platforms, Data Modeling, Data Analysis, Azure SQL Databases, SQL Server BI, SQL Server DBA, Azure Blobs, Database Architecture, Power Query, JavaScript, Microsoft Excel, OLTP, OLAP, Data Integration, Database Integration, Azure DevOps, BI Reporting, Excel 2010, SSRS Reports, Database Modeling, Minimum Viable Product (MVP), Consolidation, Stored Procedure, Cloud Migration, T-SQL (Transact-SQL), Azure SQL Data Warehouse, Dedicated SQL Pool (formerly SQL DW), Reporting, Data Cleansing, Data Quality Analysis, Database Migration, ETL Pipelines, Database Lifecycle Management (DLM), Cloud, Entity Relationships, Azure Databricks, SQL Stored Procedures, Performance Tuning, Data Management, Data Feeds, Data Extraction, C#, Architecture, Requirements Analysis, JSON

Senior SQL BI Consultant

2016 - 2017

Agile BI

Delivered high-quality BI solutions and projects for clients on BI visualization and reports, data warehousing, SSAS tabular model cube, DAX/MDX, SQL Server, Microsoft BI, and Power BI.
Modeled, designed, and developed independently a sales cube using a SSAS tabular model cube and DAX for a large wholesale/retail company.
Delivered an advanced benchmark BI system and advanced SSRS reports for a leading accounting firm using SSRS, MDX, SSAS, an OLAP cube, and SQL Server.

Technologies: SQL Server Integration Services (SSIS), SSRS Reports, SQL Server BI, DAX, Microsoft Power BI, Data Warehouse Design, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Data Engineering, SQL, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, APIs, Data Migration, ETL, ETL Tools, Business Intelligence (BI), Dashboards, Data Visualization, Data Pipelines, Data Analytics, Microsoft Access, Data, Cloud Platforms, Data Modeling, Data Analysis, Python 3, Azure SQL Databases, Spark, Azure Blobs, Database Architecture, Power Query, JavaScript, Microsoft Excel, OLTP, OLAP, Data Integration, Database Integration, Data Scraping, HTML, Azure DevOps, ELT, BI Reporting, Excel 2010, Database Modeling, Consolidation, Stored Procedure, Azure App Service, GitHub, Stripe, T-SQL (Transact-SQL), Azure SQL Data Warehouse, Dedicated SQL Pool (formerly SQL DW), Financials, Reporting, Data Cleansing, Data Quality Analysis, Database Migration, Firebase, ETL Pipelines, Database Lifecycle Management (DLM), Cloud, Entity Relationships, SQL Stored Procedures, Performance Tuning, Data Management, Data Feeds, Data Extraction, C#, JSON

Senior SQL BI Developer

2011 - 2016

Aussie Home Loan

Designed and developed independently a new data warehouse, cube, ETL, and some reports for analyzing mortgage and non-mortgage sales data (including home loan, insurance other financial data).
Designed and developed a GL cube for the finance department.
Optimized and performance-tuned a large volume BI data warehouse.

Technologies: SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS), SQL Server BI, SQL, Database Architecture, Microsoft Excel, MySQL, OLTP, OLAP, Data Integration, BI Reporting, Excel 2010, SSRS Reports, Stored Procedure, T-SQL (Transact-SQL), Financials, Reporting, Data Cleansing, Data Quality Analysis, Database Migration, ETL Pipelines, Entity Relationships, SQL Stored Procedures, Performance Tuning, Data Management, Data Feeds, Data Extraction

SQL BI Developer

2010 - 2011

Hyundai

Developed several reports using SSRS (Reporting Service 2008) for finance, marketing, and sales departments.
Oversaw and was in charge of ETL development and developed an SSIS package to extract data from an ERP system and transformed and processed the data using SQL Server 2008.
Worked with an analysis programmer and other developer to realize the system based on InfoPath, Microsoft Web Services, Workflow, and SQL Server 2008.

Technologies: SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), SQL Server BI, SQL, OLTP, OLAP, BI Reporting, SSRS Reports, Stored Procedure, T-SQL (Transact-SQL), Reporting, Data Cleansing, Data Quality Analysis, ETL Pipelines, Entity Relationships, SQL Stored Procedures, Data Extraction

Microsoft BI Developer

2006 - 2010

Pactera

Worked onsite at Microsoft and contributed to the development and support of five BI applications based on SQL Server, SSRS (reporting service), SSAS (cube), SSIS, ETL, data warehousing development, dimensional modeling design, and schema design.
Developed reports using SSRS and implemented ETL through programming store procedures and SSIS package.
Constructed the ETL with an SSIS package—slowly changing dimensions with store procedures, aggregation, a processing cube, and so on.

Technologies: C#.NET, SQL Server BI, SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), SQL, OLTP, OLAP, HTML, BI Reporting, SSRS Reports, Stored Procedure, Visual Basic for Applications (VBA), Excel VBA, Excel Macros, Macros, T-SQL (Transact-SQL), Reporting, Data Quality Analysis, ETL Pipelines, Entity Relationships, SQL Stored Procedures, C#

Experience

Australian Leading Supermarket | eCommerce DWH and Dashboard

Designed and developed an online sale and eCommerce store operations data warehouse and dashboard using Azure Data Warehouse, ADF, Azure Analysis Services cube, and Power BI technologies. The solution enabled businesses to navigate business operations better, helping businesses improve customer satisfaction, increase online sales, and save costs. I also developed the Tableau dashboard and BigQuery routines.

Blackmores | Digital Email Campaigns and Analytics

Designed and developed ETL, data warehouse, cube, and reports for digital email campaigns using ADF, logic apps, SharePoint, REST APIs, Azure Analytics Service, and Power BI. The automation saved the client lots of time instead of manually generating reports.

Intersport | Retail Inventory ETL and Dashboard

Developed Azure Function and Data Factory to extract inventory data from the REX system (SOAP API) to Azure SQL Database. I also created and designed the retail inventory dashboard and model using Power BI and supported their data warehouse and Power BI reports. This solution gave store owners and the head office instant insights into stock turnover, stock value, and other inventory metrics.

Tourism Australia | Data Warehouse and Dashboard

Developed the ETL pipelines to automate at least five data sources' extraction—including bookings, searches, flights, and visitor surveys—and orchestrated data processing from the source to the data warehouse. I also designed the Power BI data model and delivered several Power BI reports.

The solution provided instant insights to staff—from analysts to C-suite executives—and eliminated the immense amount of resources and time spent on manual reporting and data extraction.

Charity Company | Text Analytics Dashboard

Developed a text analytics dashboard of employee surveys to show the answers' sentiment and quickly identify their different domains. I used Microsoft's cognitive Text Analytics API, Python, NLP, GloVe, machine learning, and Power BI.

The project aimed to quickly identify important answers from a large number of survey responses every year to uncover the issues in the business and identify opportunities to improve services.

Star Group | Real-time Big Data Architecture

Delivered a real-time big data architecture, which entailed developing a real-time big data IoT, machine learning, and advanced analytics platform.

This platform was built to support next-generation analytics, including processing structure and unstructured data, real-time data ingestion, analytics, and machine learning.

Deloitte | Motor Industry Benchmark BI System

Designed and developed a motor industry benchmark BI system and several BI reports and dashboards for the eProfit system using Microsoft's reporting service, MDX, SSIS, and SQL Server.

Moreover, I tackled the challenging performance issue caused by previous design by reverse engineering and reinventing the "engine." The solution enabled extensive reports to be rolled out to the end users and has since been recognized and applauded by the CIO and partners.

Aussie Home Loan | Mortgage Sales DWH and Reports

Independently designed and developed the new data warehouse, cube, ETL, and some reports for the mortgage sales from scratch based on SQL Server, dimensional modeling, SSRS, SSAS, SSIS, MDX, and T-SQL. The reports were being used by sales managers and executives daily. In addition, I enhanced the cube to enable users to do self-servicing reports using Excel.

SaaS Ecommerce Web Platform

Independently designed and developed a SaaS eCommerce web platform using Angular 8+, .Net Core, REST API, and Azure SQL Database. Users can register a store on this platform and the store has all the eCommerce features.

Revenue Management Consultancy Company | Data Integration

Delivered the data integration project, which involved developing an ADF pipeline, Azure Function, and C# Web API to integrate data—including invoice, sales, customer, product, and payment—from SAP IDoc XML, SFTP, CSV, and REST API to the Azure SQL Database. I also built pipelines to export the data for different clients in the retail FMCG industry.

Additionally, I created blob-triggered Azure Functions to transform XML data, including XSD validation and XSLT transformation, generating and sending output files to clients by API. I also designed the pipeline to ingest Excel and CSV files into the integration database, transforming and unpivoting the Excel data and exporting them to clients using ADF data flows.

Python IoT Project

Developed various Azure Functions as a Python IoT developer. Among these were Azure Functions that:

• Receive, validate, and process XML messages from IoT devices.
• Write and read data from Cosmos DB.
• Push messages to the Azure Storage Queue.
• Was triggered by Cosmos DB feed and Azure Storage Queue changes.

Skills

Languages

SQL, HTML, Stored Procedure, T-SQL (Transact-SQL), C#.NET, Python 3, Python, XML, Batch, JavaScript, Visual Basic for Applications (VBA), C#, XSLT, XSD, Snowflake, Excel VBA

Tools

SQL Server BI, Microsoft Power BI, Microsoft Access, Microsoft Excel, Excel 2010, Azure Logic Apps, Tableau, BigQuery, Azure App Service, GitHub, Jira, Apache Airflow, Azure Machine Learning, Tableau Desktop Pro, Power Query, Google Analytics, Looker, Spark SQL

Paradigms

Dimensional Modeling, Business Intelligence (BI), Database Design, ETL, OLAP, REST, Azure DevOps, Requirements Analysis, Data Science

Platforms

Azure, Azure SQL Data Warehouse, Dedicated SQL Pool (formerly SQL DW), Azure Synapse, Databricks, Azure Functions, Google Cloud Platform (GCP), Azure Event Hubs, Apache Kafka, Firebase

Storage

SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Azure SQL, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Relational Databases, Databases, Data Pipelines, OLTP, Data Integration, Database Integration, Database Modeling, Database Migration, Database Lifecycle Management (DLM), SQL Stored Procedures, JSON, Azure Blobs, Azure SQL Databases, Data Lake Design, Data Lakes, Database Architecture, Azure Queue Storage, SQL Server 2016, PostgreSQL, Redshift, Azure Cosmos DB, Database Administration (DBA), SQL Server DBA, NoSQL, MySQL, PL/SQL, Amazon S3 (AWS S3)

Other

Azure Data Factory, Data Modeling, Data Warehouse Design, Data Engineering, Data Warehousing, Data Migration, API Connectors, ETL Tools, Data Analytics, Data, Cloud Platforms, ELT, BI Reporting, SSRS Reports, Minimum Viable Product (MVP), Consolidation, Reporting, Data Cleansing, Data Quality Analysis, ETL Pipelines, Cloud, Entity Relationships, Performance Tuning, Data Extraction, Azure Analysis Services, APIs, Dashboards, DAX, Data Visualization, Data Analysis, Webhooks, Cloud Migration, eCommerce, Financials, Big Data, Azure Databricks, Data Management, Data Feeds, Delta Lake, Architecture, Azure Stream Analytics, GloVe, Natural Language Processing (NLP), Data Architecture, Google BigQuery, Machine Learning, Azure Data Lake, GPT, Generative Pre-trained Transformers (GPT), SAP IDoc, Web Scraping, Data Scraping, Scientific Data Analysis, Excel Macros, Macros, SAP, Google Data Studio

Frameworks

Angular, Spark, .NET, .NET Core, Angular Material, ASP.NET Web API, Apache Spark, Hadoop

Libraries/APIs

ODBC, Pandas, Azure Cognitive Services, Azure API Management, Salesforce API, Stripe

Industry Expertise

Marketing

Education

1999 - 2003

Bachelor's Degree in Computer Science

Shijiazhuang Tiedao University - Hebei, China

Certifications

APRIL 2018 - PRESENT

Neural Networks and Deep Learning

Coursera

JUNE 2017 - PRESENT

MCSE: Cloud Platform and Infrastructure — Certified 2017

Microsoft

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring