Edison Zhu
Azure BI Developer
Location
Sydney, New South Wales, Australia
Toptal Member Since
July 7, 2021
Edison is an Azure BI developer, data engineer, and data architect with 18 years of BI and data engineering experience across industries. Backed by an MCSE Azure Cloud Platform certification, he delivers high-quality BI solutions using Azure Data Factory (ADF), Python, Azure Functions, Azure SQL Database, Azure Synapse, Power BI, Databricks, Analysis Service, and SQL Server. Edison also excels at dimensional modeling, performance turning large data warehouses, and .NET and Angular development.
Edison is available for hire
Hire EdisonPortfolio
Acumen Commercial Insights
Data Engineering, Azure Data Factory, XML, SQL, REST, ETL Tools, APIs...
Woolworths
Azure Synapse, Azure Analysis Services, Microsoft Power BI, Azure Data Factory...
Antares Solutions
Azure Data Factory, Databricks, Azure Analysis Services, Microsoft Power BI...
Experience
ETL - 18 yearsSQL Server BI - 16 yearsAzure SQL Databases - 9 yearsAzure Data Factory - 9 yearsMicrosoft Power BI - 8 yearsAzure Analysis Services - 6 yearsAzure Synapse - 5 yearsPython 3 - 3 yearsLocation
Availability
Full-time
Preferred Environment
Azure PaaS, SQL Server BI, Windows 10, Visual Studio, Python 3, Microsoft Power BI, Azure Data Factory, Azure Functions, Tableau Desktop Pro, Google BigQuery
The most amazing...
...enterprise projects I've delivered end-to-end helped businesses make data-driven decisions and make business operations more efficient.
Work Experience
2022 - 2023
Azure Data Engineer
Acumen Commercial Insights
- Delivered a data integration project in the retail FMCG industry.
- Built an ADF pipeline, Azure Function, and C# Web API to integrate data—including invoice, sales, customer, product, and payment—from SAP IDoc XML, SFTP, and API to the Azure SQL Database.
- Developed a Blob-triggered Azure Function for multiple clients to transform XML data—including XSD validation and XSLT transformation—generating an output file and sending it to the client by API.
- Designed the pipeline to ingest Excel and CSV files into the integration database, transform the Excel data to unpivot the data, and export the data to clients using ADF data flows.
Technologies: Data Engineering, Azure Data Factory, XML, SQL, REST, ETL Tools, APIs, Azure Functions, ASP.NET Web API, Database Architecture, Webhooks
2020 - 2022
Senior Azure BI, Power BI, & Tableau Developer
Woolworths
- Designed and developed the store operation, performance, delivery, and product availability Power BI dashboards, data warehouse, dimensional modeling, and Tableau dashboard using Azure Synapse, ADF, Power BI, Tableau, and BigQuery.
- Delivered multiple ADF pipelines to dynamically copy data into Azure Blob Storage as per business request.
- Built a data ingestion pipeline with Python to integrate Google Sheet's data into GCP BigQuery and Storage Buckets.
- Migrated the seven existing fulfillment web reports of Woolworths' online sales to SSRS reports using Azure Synapse and SSRS.
- Created Azure Functions to process XML messages with Python, Service Bus, Cosmos DB, and Azure Storage Queue.
- Developed Tableau dashboards against GCP BigQuery for supermarket delivery operations.
Technologies: Azure Synapse, Azure Analysis Services, Microsoft Power BI, Azure Data Factory, Tableau, Azure SQL Databases, Azure Logic Apps, Data Warehouse Design, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Data Engineering, SQL, Google BigQuery, DAX, Apache Airflow, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, APIs, Data Migration, API Connectors, ETL, XML, REST, ETL Tools, Business Intelligence (BI), Dashboards, Data Visualization, Pandas, Data Pipelines, Data Analytics, Data Lake Design, Data Lakes, Data, Cloud Platforms, Data Modeling, Data Analysis, Python 3, Azure Functions, SQL Server BI, Database Administration (DBA), SQL Server DBA, Azure Blobs, BigQuery, NoSQL, Webhooks
2018 - 2020
Azure Data Engineer & Data Architect
Antares Solutions
- Designed and developed the ETL, data warehouse, cube, and reports of a digital email campaign for a leading health supplement company. This automation saved the client a substantial amount of time.
- Delivered a real-time big data analytics architecture, which included a real-time big data IoT, machine learning, and advanced analytics platform for a leading entertainment company.
- Developed text classification for clients using Python, Keras, word embedding, NLP, Word2vec, GloVe, deep learning, and CNN.
- Produced a movie recommendation proof of concept using Azure Databricks, machine learning, collaborative filtering, real-time data ingestion, Azure Event Hubs, Spark MLlib, and Python.
- Created a data integration pipeline to ingest SAP IDoc XML data—including invoice, sales, customer, product, and payment—into the integration database using ADF, Azure SQL Database, and Azure Blob Storage.
- Built a Blob-triggered Azure Function for multiple clients to transform XML data—including XSD validation and XSLT transformation—generating an output file and sending it to the client by API.
Technologies: Azure Data Factory, Databricks, Azure Analysis Services, Microsoft Power BI, SSRS Reports, SQL Server Integration Services (SSIS), Python, Azure Event Hubs, Azure Stream Analytics, Azure Logic Apps, GloVe, Generative Pre-trained Transformers (GPT), Natural Language Processing (NLP), GPT, Data Warehouse Design, Microsoft SQL Server, Data Architecture, SQL Server Analysis Services (SSAS), Data Engineering, SQL, DAX, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, Azure Machine Learning, APIs, Data Migration, API Connectors, ETL, XML, REST, ETL Tools, Business Intelligence (BI), Dashboards, Data Visualization, Pandas, Data Pipelines, Data Analytics, Marketing, PostgreSQL, Data Lake Design, Data Lakes, Data, Redshift, Cloud Platforms, Data Modeling, Data Analysis, Azure Functions, Azure SQL Databases, SQL Server BI, Database Administration (DBA), SQL Server DBA, Spark, Azure Blobs, Salesforce, Salesforce API, ASP.NET Web API, Database Architecture, BigQuery, NoSQL
2017 - 2018
Senior Azure BI Developer
Woolworths Group
- Designed and built a dimensional modeling data warehouse, a tabular cube, and Power BI dashboard of online sales using Azure Data Warehouse, Azure Analysis Services cube, and Power BI.
- Performance-tuned large volume data with table partition, cube partition, polybase, and hash distribution on Azure Data Warehouse.
- Automated the cube process using Azure Automation account, runbooks, and webhooks.
Technologies: Azure Data Factory, Azure Synapse, Microsoft Power BI, Azure Analysis Services, Azure Logic Apps, Data Warehouse Design, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Data Engineering, SQL, DAX, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, Data Migration, ETL, ETL Tools, Business Intelligence (BI), Dashboards, Tableau, Data Visualization, Data Pipelines, Data Analytics, Data Lake Design, Data Lakes, Data, Cloud Platforms, Data Modeling, Data Analysis, Azure SQL Databases, SQL Server BI, SQL Server DBA, Azure Blobs, Database Architecture
2016 - 2017
Senior SQL BI Consultant
Agile BI
- Delivered high-quality BI solutions and projects for clients on BI visualization and reports, data warehousing, SSAS tabular model cube, DAX/MDX, SQL Server, Microsoft BI, and Power BI.
- Modeled, designed, and developed independently a sales cube using a SSAS tabular model cube and DAX for a large wholesale/retail company.
- Delivered an advanced benchmark BI system and advanced SSRS reports for a leading accounting firm using SSRS, MDX, SSAS, an OLAP cube, and SQL Server.
Technologies: SQL Server Integration Services (SSIS), SSRS Reports, SQL Server BI, SSAS Tabular, DAX, Microsoft Power BI, MDX, Data Warehouse Design, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Data Engineering, SQL, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, APIs, Data Migration, ETL, ETL Tools, Business Intelligence (BI), Dashboards, Data Visualization, Data Pipelines, Data Analytics, Microsoft Access, Data, Cloud Platforms, Data Modeling, Data Analysis, Python 3, Azure SQL Databases, Spark, Azure Blobs, Database Architecture
2011 - 2016
Senior SQL BI Developer
Aussie Home Loan
- Designed and developed independently a new data warehouse, cube, ETL, and some reports for analyzing mortgage and non-mortgage sales data (including home loan, insurance other financial data).
- Designed and developed a GL cube for the finance department.
- Optimized and performance-tuned a large volume BI data warehouse.
Technologies: SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS), SQL Server BI, SQL, Database Architecture
2010 - 2011
SQL BI Developer
Hyundai
- Developed several reports using SSRS (Reporting Service 2008) for finance, marketing, and sales departments.
- Oversaw and was in charge of ETL development and developed an SSIS package to extract data from an ERP system and transformed and processed the data using SQL Server 2008.
- Worked with an analysis programmer and other developer to realize the system based on InfoPath, Microsoft Web Services, Workflow, and SQL Server 2008.
Technologies: SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), SQL Server BI, SQL
2006 - 2010
Microsoft BI Developer
Pactera
- Worked onsite at Microsoft and contributed to the development and support of five BI applications based on SQL Server, SSRS (reporting service), SSAS (cube), SSIS, ETL, data warehousing development, dimensional modeling design, and schema design.
- Developed reports using SSRS and implemented ETL through programming store procedures and SSIS package.
- Constructed the ETL with an SSIS package—slowly changing dimensions with store procedures, aggregation, a processing cube, and so on.
Technologies: C#.NET, SQL Server BI, SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Multidimensional Expressions (MDX), SQL
Experience
Australian Leading Supermarket | eCommerce DWH and Dashboard
Designed and developed an online sale and eCommerce store operations data warehouse and dashboard using Azure Data Warehouse, ADF, Azure Analysis Services cube, and Power BI technologies. The solution enabled businesses to navigate business operations better, helping businesses improve customer satisfaction, increase online sales, and save costs. I also developed the Tableau dashboard and BigQuery routines.
Blackmores | Digital Email Campaigns and Analytics
Designed and developed ETL, data warehouse, cube, and reports for digital email campaigns using ADF, logic apps, SharePoint, REST APIs, Azure Analytics Service, and Power BI. The automation saved the client lots of time instead of manually generating reports.
Intersport | Retail Inventory ETL and Dashboard
Developed Azure Function and Data Factory to extract inventory data from the REX system (SOAP API) to Azure SQL Database. I also created and designed the retail inventory dashboard and model using Power BI and supported their data warehouse and Power BI reports. This solution gave store owners and the head office instant insights into stock turnover, stock value, and other inventory metrics.
Tourism Australia | Data Warehouse and Dashboard
Developed the ETL pipelines to automate at least five data sources' extraction—including bookings, searches, flights, and visitor surveys—and orchestrated data processing from the source to the data warehouse. I also designed the Power BI data model and delivered several Power BI reports.
The solution provided instant insights to staff—from analysts to C-suite executives—and eliminated the immense amount of resources and time spent on manual reporting and data extraction.
The solution provided instant insights to staff—from analysts to C-suite executives—and eliminated the immense amount of resources and time spent on manual reporting and data extraction.
Charity Company | Text Analytics Dashboard
Developed a text analytics dashboard of employee surveys to show the answers' sentiment and quickly identify their different domains. I used Microsoft's cognitive Text Analytics API, Python, NLP, GloVe, machine learning, and Power BI.
The project aimed to quickly identify important answers from a large number of survey responses every year to uncover the issues in the business and identify opportunities to improve services.
The project aimed to quickly identify important answers from a large number of survey responses every year to uncover the issues in the business and identify opportunities to improve services.
Star Group | Real-time Big Data Architecture
Delivered a real-time big data architecture, which entailed developing a real-time big data IoT, machine learning, and advanced analytics platform.
This platform was built to support next-generation analytics, including processing structure and unstructured data, real-time data ingestion, analytics, and machine learning.
This platform was built to support next-generation analytics, including processing structure and unstructured data, real-time data ingestion, analytics, and machine learning.
Deloitte | Motor Industry Benchmark BI System
Designed and developed a motor industry benchmark BI system and several BI reports and dashboards for the eProfit system using Microsoft's reporting service, MDX, SSIS, and SQL Server.
Moreover, I tackled the challenging performance issue caused by previous design by reverse engineering and reinventing the "engine." The solution enabled extensive reports to be rolled out to the end users and has since been recognized and applauded by the CIO and partners.
Moreover, I tackled the challenging performance issue caused by previous design by reverse engineering and reinventing the "engine." The solution enabled extensive reports to be rolled out to the end users and has since been recognized and applauded by the CIO and partners.
Aussie Home Loan | Mortgage Sales DWH and Reports
Independently designed and developed the new data warehouse, cube, ETL, and some reports for the mortgage sales from scratch based on SQL Server, dimensional modeling, SSRS, SSAS, SSIS, MDX, and T-SQL. The reports were being used by sales managers and executives daily. In addition, I enhanced the cube to enable users to do self-servicing reports using Excel.
SaaS Ecommerce Web Platform
Independently designed and developed a SaaS eCommerce web platform using Angular 8+, .Net Core, REST API, and Azure SQL Database. Users can register a store on this platform and the store has all the eCommerce features.
Revenue Management Consultancy Company | Data Integration
Delivered the data integration project, which involved developing an ADF pipeline, Azure Function, and C# Web API to integrate data—including invoice, sales, customer, product, and payment—from SAP IDoc XML, SFTP, CSV, and REST API to the Azure SQL Database. I also built pipelines to export the data for different clients in the retail FMCG industry.
Additionally, I created blob-triggered Azure Functions to transform XML data, including XSD validation and XSLT transformation, generating and sending output files to clients by API. I also designed the pipeline to ingest Excel and CSV files into the integration database, transforming and unpivoting the Excel data and exporting them to clients using ADF data flows.
Additionally, I created blob-triggered Azure Functions to transform XML data, including XSD validation and XSLT transformation, generating and sending output files to clients by API. I also designed the pipeline to ingest Excel and CSV files into the integration database, transforming and unpivoting the Excel data and exporting them to clients using ADF data flows.
Python IoT Project
Developed various Azure Functions as a Python IoT developer. Among these were Azure Functions that:
• Receive, validate, and process XML messages from IoT devices.
• Write and read data from Cosmos DB.
• Push messages to the Azure Storage Queue.
• Was triggered by Cosmos DB feed and Azure Storage Queue changes.
• Receive, validate, and process XML messages from IoT devices.
• Write and read data from Cosmos DB.
• Push messages to the Azure Storage Queue.
• Was triggered by Cosmos DB feed and Azure Storage Queue changes.
Skills
Languages
SQL, C#.NET, Python 3, XML, Batch, Python, XSLT, XSD
Tools
SQL Server BI, Microsoft Power BI, Microsoft Access, Azure Logic Apps, Tableau, BigQuery, Apache Airflow, Azure Machine Learning, Tableau Desktop Pro
Paradigms
Dimensional Modeling, Business Intelligence (BI), Database Design, ETL, REST
Storage
SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Azure SQL, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Relational Databases, Databases, Data Pipelines, Azure Blobs, Azure SQL Databases, Data Lake Design, Data Lakes, Database Architecture, SQL Server 2016, PostgreSQL, Redshift, Azure Cosmos DB, Database Administration (DBA), SQL Server DBA, NoSQL
Other
Azure Data Factory, Data Modeling, Data Warehouse Design, Data Engineering, Data Warehousing, Data Migration, API Connectors, ETL Tools, Data Analytics, Data, Cloud Platforms, Azure Synapse, Azure Analysis Services, APIs, Dashboards, DAX, Data Visualization, Data Analysis, Webhooks, Azure Stream Analytics, GloVe, Natural Language Processing (NLP), Data Architecture, Google BigQuery, Machine Learning, Azure Data Lake, GPT, Generative Pre-trained Transformers (GPT), SAP IDoc
Frameworks
Angular, Spark, .NET Core, Angular Material, ASP.NET Web API
Platforms
Azure, Azure Functions, Databricks, Azure Event Hubs
Libraries/APIs
Pandas, Azure Cognitive Services, Azure API Management, Salesforce API
Industry Expertise
Marketing
Education
1999 - 2003
Bachelor's Degree in Computer Science
Shijiazhuang Tiedao University - Hebei, China
Certifications
APRIL 2018 - PRESENT
Neural Networks and Deep Learning
Coursera
JUNE 2017 - PRESENT
MCSE: Cloud Platform and Infrastructure — Certified 2017
Microsoft