Edison is available for hire
Hire EdisonEdison Zhu
Verified Expert in Engineering
Azure BI Developer
Location
Sydney, New South Wales, Australia
Toptal Member Since
July 7, 2021
Edison is an Azure BI developer, data engineer, and data architect with 18 years of BI and data engineering experience across industries. Backed by an MCSE Azure Cloud Platform certification, he delivers high-quality BI solutions using Azure Data Factory (ADF), Python, Azure Functions, Azure SQL Database, Azure Synapse, Power BI, Databricks, Analysis Service, and SQL Server. Edison also excels at dimensional modeling, performance turning large data warehouses, and .NET and Angular development.
Portfolio
Woolworths
Azure Synapse, Azure Analysis Services, Microsoft Power BI, Azure Data Factory...
Acumen Commercial Insights
Data Engineering, Azure Data Factory, XML, SQL, REST, ETL Tools, APIs...
Antares Solutions
Azure Data Factory, Databricks, Azure Analysis Services, Microsoft Power BI...
Experience
Availability
Full-time
Preferred Environment
Azure PaaS, SQL Server BI, Windows 10, Visual Studio, Python 3, Microsoft Power BI, Azure Data Factory, Azure Functions, Tableau Desktop Pro, Google BigQuery
The most amazing...
...enterprise projects I've delivered end-to-end helped businesses make data-driven decisions and make business operations more efficient.
Work Experience
Senior Azure BI, Data Engineer, Power BI, Tableau, BigQuery, Python Developer
2020 - PRESENT
Woolworths
- Designed and developed the online sales dashboard, store operation dashboard, point-to-point delivery dashboard, and product availability dashboards using Microsoft Power BI, Azure Synapse, Azure Analysis Services, and DAX.
- Delivered the Data Factory ETL pipelines to dynamically copy data into Azure Blob Storage and load the dimension and fact tables.
- Designed and developed the data warehouse, analysis service cube, ETL process, and dimensional modeling.
- Migrated the seven existing fulfillment web reports of Woolworths' online sales to SSRS reports using Azure Synapse and SSRS.
- Created Azure Functions to process XML messages with Python, Azure Service Bus, Cosmos DB, and Azure Storage Queue.
- Developed point-to-point delivery and Online KPI Tableau dashboards using GCP BigQuery and Tableau.
- Built a data ingestion pipeline with Python to integrate Google Sheet's data into GCP BigQuery and Storage Buckets.
- Created the Azure Functions to create IotHub and Stream Analytics automatically.
- Changed the Power Query to add the features to a Power BI report.
Technologies: Azure Synapse, Azure Analysis Services, Microsoft Power BI, Azure Data Factory, Tableau, Azure SQL Databases, Azure Logic Apps, Data Warehouse Design, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Data Engineering, SQL, Google BigQuery, DAX, Apache Airflow, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, APIs, Data Migration, API Connectors, ETL, XML, REST, ETL Tools, Business Intelligence (BI), Dashboards, Data Visualization, Pandas, Data Pipelines, Data Analytics, Data Lake Design, Data Lakes, Data, Cloud Platforms, Data Modeling, Data Analysis, Python 3, Azure Functions, SQL Server BI, Database Administration (DBA), SQL Server DBA, Azure Blobs, BigQuery, NoSQL, Webhooks, Power Query, ODBC, Microsoft Excel, OLTP, OLAP, Data Integration, Database Integration, Google Cloud Platform (GCP), Azure DevOps, ELT, BI Reporting, Excel 2010, SSRS Reports, Database Modeling, Minimum Viable Product (MVP), Consolidation, Stored Procedure, Cloud Migration, eCommerce, Looker, Jira, T-SQL (Transact-SQL), Azure SQL Data Warehouse (SQL DW), Reporting, SAP, Data Cleansing, Data Quality Analysis, Database Migration, Google Data Studio, ETL Pipelines, Database Lifecycle Management (DLM), Cloud, Entity Relationships, Azure Databricks, SQL Stored Procedures, Performance Tuning
Azure Data Engineer
2022 - 2022
Acumen Commercial Insights
- Delivered a data integration project in the retail FMCG industry.
- Built an ADF pipeline, Azure Function, and C# Web API to integrate data—including invoice, sales, customer, product, and payment—from SAP IDoc XML, SFTP, and API to the Azure SQL Database.
- Developed a Blob-triggered Azure Function for multiple clients to transform XML data—including XSD validation and XSLT transformation—generating an output file and sending it to the client by API.
- Designed the pipeline to ingest Excel and CSV files into the integration database, transform the Excel data to unpivot the data, and export the data to clients using ADF data flows.
Technologies: Data Engineering, Azure Data Factory, XML, SQL, REST, ETL Tools, APIs, Azure Functions, ASP.NET Web API, Database Architecture, Webhooks, Microsoft Excel, Azure Queue, Data Integration, Database Integration, HTML, Azure DevOps, Excel 2010, Database Modeling, Minimum Viable Product (MVP), Consolidation, Stored Procedure, Azure App Service, GitHub, Jira, T-SQL (Transact-SQL), SAP, Data Cleansing, Data Quality Analysis, Database Migration, ETL Pipelines, Database Lifecycle Management (DLM), Cloud, Entity Relationships, SQL Stored Procedures, Performance Tuning
Azure Data Engineer & Data Architect
2018 - 2020
Antares Solutions
- Designed and developed the ETL, data warehouse, cube, and reports of a digital email campaign for a leading health supplement company. This automation saved the client a substantial amount of time.
- Delivered a real-time big data analytics architecture, which included a real-time big data IoT, machine learning, and advanced analytics platform for a leading entertainment company.
- Developed text classification for clients using Python, Keras, word embedding, NLP, Word2vec, GloVe, deep learning, and CNN.
- Produced a movie recommendation proof of concept using Azure Databricks, machine learning, collaborative filtering, real-time data ingestion, Azure Event Hubs, Spark MLlib, and Python.
- Created a data integration pipeline to ingest SAP IDoc XML data—including invoice, sales, customer, product, and payment—into the integration database using ADF, Azure SQL Database, and Azure Blob Storage.
- Built a Blob-triggered Azure Function for multiple clients to transform XML data—including XSD validation and XSLT transformation—generating an output file and sending it to the client by API.
Technologies: Azure Data Factory, Databricks, Azure Analysis Services, Microsoft Power BI, SSRS Reports, SQL Server Integration Services (SSIS), Python, Azure Event Hubs, Azure Stream Analytics, Azure Logic Apps, GloVe, GPT, Natural Language Processing (NLP), Generative Pre-trained Transformers (GPT), Data Warehouse Design, Microsoft SQL Server, Data Architecture, SQL Server Analysis Services (SSAS), Data Engineering, SQL, DAX, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, Azure Machine Learning, APIs, Data Migration, API Connectors, ETL, XML, REST, ETL Tools, Business Intelligence (BI), Dashboards, Data Visualization, Pandas, Data Pipelines, Data Analytics, Marketing, PostgreSQL, Data Lake Design, Data Lakes, Data, Redshift, Cloud Platforms, Data Modeling, Data Analysis, Azure Functions, Azure SQL Databases, SQL Server BI, Database Administration (DBA), SQL Server DBA, Spark, Azure Blobs, Salesforce API, ASP.NET Web API, Database Architecture, BigQuery, NoSQL, Power Query, ODBC, JavaScript, Microsoft Excel, OLTP, OLAP, Snowflake, Data Integration, Database Integration, Web Scraping, Data Scraping, Scientific Data Analysis, Google Analytics, HTML, Azure DevOps, Apache Spark, ELT, BI Reporting, Excel 2010, Database Modeling, Minimum Viable Product (MVP), Consolidation, PL/SQL, Stored Procedure, Azure App Service, GitHub, Cloud Migration, eCommerce, Jira, T-SQL (Transact-SQL), Azure SQL Data Warehouse (SQL DW), Reporting, Hadoop, Data Cleansing, Data Quality Analysis, Data Science, Database Migration, Big Data, ETL Pipelines, Database Lifecycle Management (DLM), Cloud, Entity Relationships, Amazon S3 (AWS S3), Azure Databricks, SQL Stored Procedures, Performance Tuning
Senior Azure BI Developer
2017 - 2018
Woolworths Group
- Designed and built a dimensional modeling data warehouse, a tabular cube, and Power BI dashboard of online sales using Azure Data Warehouse, Azure Analysis Services cube, and Power BI.
- Performance-tuned large volume data with table partition, cube partition, polybase, and hash distribution on Azure Data Warehouse.
- Automated the cube process using Azure Automation account, runbooks, and webhooks.
Technologies: Azure Data Factory, Azure Synapse, Microsoft Power BI, Azure Analysis Services, Azure Logic Apps, Data Warehouse Design, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Data Engineering, SQL, DAX, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, Data Migration, ETL, ETL Tools, Business Intelligence (BI), Dashboards, Tableau, Data Visualization, Data Pipelines, Data Analytics, Data Lake Design, Data Lakes, Data, Cloud Platforms, Data Modeling, Data Analysis, Azure SQL Databases, SQL Server BI, SQL Server DBA, Azure Blobs, Database Architecture, Power Query, JavaScript, Microsoft Excel, OLTP, OLAP, Data Integration, Database Integration, Azure DevOps, BI Reporting, Excel 2010, SSRS Reports, Database Modeling, Minimum Viable Product (MVP), Consolidation, Stored Procedure, Cloud Migration, T-SQL (Transact-SQL), Azure SQL Data Warehouse (SQL DW), Reporting, Data Cleansing, Data Quality Analysis, Database Migration, ETL Pipelines, Database Lifecycle Management (DLM), Cloud, Entity Relationships, Azure Databricks, SQL Stored Procedures, Performance Tuning
Senior SQL BI Consultant
2016 - 2017
Agile BI
- Delivered high-quality BI solutions and projects for clients on BI visualization and reports, data warehousing, SSAS tabular model cube, DAX/MDX, SQL Server, Microsoft BI, and Power BI.
- Modeled, designed, and developed independently a sales cube using a SSAS tabular model cube and DAX for a large wholesale/retail company.
- Delivered an advanced benchmark BI system and advanced SSRS reports for a leading accounting firm using SSRS, MDX, SSAS, an OLAP cube, and SQL Server.
Technologies: SQL Server Integration Services (SSIS), SSRS Reports, SQL Server BI, DAX, Microsoft Power BI, Data Warehouse Design, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Data Engineering, SQL, Azure SQL, Database Design, Azure, Relational Databases, Databases, Data Warehousing, APIs, Data Migration, ETL, ETL Tools, Business Intelligence (BI), Dashboards, Data Visualization, Data Pipelines, Data Analytics, Microsoft Access, Data, Cloud Platforms, Data Modeling, Data Analysis, Python 3, Azure SQL Databases, Spark, Azure Blobs, Database Architecture, Power Query, JavaScript, Microsoft Excel, OLTP, OLAP, Data Integration, Database Integration, Data Scraping, HTML, Azure DevOps, ELT, BI Reporting, Excel 2010, Database Modeling, Consolidation, Stored Procedure, Azure App Service, GitHub, Stripe, T-SQL (Transact-SQL), Azure SQL Data Warehouse (SQL DW), Financials, Reporting, Data Cleansing, Data Quality Analysis, Database Migration, Firebase, ETL Pipelines, Database Lifecycle Management (DLM), Cloud, Entity Relationships, SQL Stored Procedures, Performance Tuning
Senior SQL BI Developer
2011 - 2016
Aussie Home Loan
- Designed and developed independently a new data warehouse, cube, ETL, and some reports for analyzing mortgage and non-mortgage sales data (including home loan, insurance other financial data).
- Designed and developed a GL cube for the finance department.
- Optimized and performance-tuned a large volume BI data warehouse.
Technologies: SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS), SQL Server BI, SQL, Database Architecture, Microsoft Excel, MySQL, OLTP, OLAP, Data Integration, BI Reporting, Excel 2010, SSRS Reports, Stored Procedure, T-SQL (Transact-SQL), Financials, Reporting, Data Cleansing, Data Quality Analysis, Database Migration, ETL Pipelines, Entity Relationships, SQL Stored Procedures, Performance Tuning
SQL BI Developer
2010 - 2011
Hyundai
- Developed several reports using SSRS (Reporting Service 2008) for finance, marketing, and sales departments.
- Oversaw and was in charge of ETL development and developed an SSIS package to extract data from an ERP system and transformed and processed the data using SQL Server 2008.
- Worked with an analysis programmer and other developer to realize the system based on InfoPath, Microsoft Web Services, Workflow, and SQL Server 2008.
Technologies: SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), SQL Server BI, SQL, OLTP, OLAP, BI Reporting, SSRS Reports, Stored Procedure, T-SQL (Transact-SQL), Reporting, Data Cleansing, Data Quality Analysis, ETL Pipelines, Entity Relationships, SQL Stored Procedures
Microsoft BI Developer
2006 - 2010
Pactera
- Worked onsite at Microsoft and contributed to the development and support of five BI applications based on SQL Server, SSRS (reporting service), SSAS (cube), SSIS, ETL, data warehousing development, dimensional modeling design, and schema design.
- Developed reports using SSRS and implemented ETL through programming store procedures and SSIS package.
- Constructed the ETL with an SSIS package—slowly changing dimensions with store procedures, aggregation, a processing cube, and so on.
Technologies: C#.NET, SQL Server BI, SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), SQL, OLTP, OLAP, HTML, BI Reporting, SSRS Reports, Stored Procedure, Visual Basic for Applications (VBA), Excel VBA, Excel Macros, Macros, T-SQL (Transact-SQL), Reporting, Data Quality Analysis, ETL Pipelines, Entity Relationships, SQL Stored Procedures
Experience
Australian Leading Supermarket | eCommerce DWH and Dashboard
Designed and developed an online sale and eCommerce store operations data warehouse and dashboard using Azure Data Warehouse, ADF, Azure Analysis Services cube, and Power BI technologies. The solution enabled businesses to navigate business operations better, helping businesses improve customer satisfaction, increase online sales, and save costs. I also developed the Tableau dashboard and BigQuery routines.
Blackmores | Digital Email Campaigns and Analytics
Designed and developed ETL, data warehouse, cube, and reports for digital email campaigns using ADF, logic apps, SharePoint, REST APIs, Azure Analytics Service, and Power BI. The automation saved the client lots of time instead of manually generating reports.
Intersport | Retail Inventory ETL and Dashboard
Developed Azure Function and Data Factory to extract inventory data from the REX system (SOAP API) to Azure SQL Database. I also created and designed the retail inventory dashboard and model using Power BI and supported their data warehouse and Power BI reports. This solution gave store owners and the head office instant insights into stock turnover, stock value, and other inventory metrics.
Tourism Australia | Data Warehouse and Dashboard
Developed the ETL pipelines to automate at least five data sources' extraction—including bookings, searches, flights, and visitor surveys—and orchestrated data processing from the source to the data warehouse. I also designed the Power BI data model and delivered several Power BI reports.
The solution provided instant insights to staff—from analysts to C-suite executives—and eliminated the immense amount of resources and time spent on manual reporting and data extraction.
The solution provided instant insights to staff—from analysts to C-suite executives—and eliminated the immense amount of resources and time spent on manual reporting and data extraction.
Charity Company | Text Analytics Dashboard
Developed a text analytics dashboard of employee surveys to show the answers' sentiment and quickly identify their different domains. I used Microsoft's cognitive Text Analytics API, Python, NLP, GloVe, machine learning, and Power BI.
The project aimed to quickly identify important answers from a large number of survey responses every year to uncover the issues in the business and identify opportunities to improve services.
The project aimed to quickly identify important answers from a large number of survey responses every year to uncover the issues in the business and identify opportunities to improve services.
Star Group | Real-time Big Data Architecture
Delivered a real-time big data architecture, which entailed developing a real-time big data IoT, machine learning, and advanced analytics platform.
This platform was built to support next-generation analytics, including processing structure and unstructured data, real-time data ingestion, analytics, and machine learning.
This platform was built to support next-generation analytics, including processing structure and unstructured data, real-time data ingestion, analytics, and machine learning.
Deloitte | Motor Industry Benchmark BI System
Designed and developed a motor industry benchmark BI system and several BI reports and dashboards for the eProfit system using Microsoft's reporting service, MDX, SSIS, and SQL Server.
Moreover, I tackled the challenging performance issue caused by previous design by reverse engineering and reinventing the "engine." The solution enabled extensive reports to be rolled out to the end users and has since been recognized and applauded by the CIO and partners.
Moreover, I tackled the challenging performance issue caused by previous design by reverse engineering and reinventing the "engine." The solution enabled extensive reports to be rolled out to the end users and has since been recognized and applauded by the CIO and partners.
Aussie Home Loan | Mortgage Sales DWH and Reports
Independently designed and developed the new data warehouse, cube, ETL, and some reports for the mortgage sales from scratch based on SQL Server, dimensional modeling, SSRS, SSAS, SSIS, MDX, and T-SQL. The reports were being used by sales managers and executives daily. In addition, I enhanced the cube to enable users to do self-servicing reports using Excel.
SaaS Ecommerce Web Platform
Independently designed and developed a SaaS eCommerce web platform using Angular 8+, .Net Core, REST API, and Azure SQL Database. Users can register a store on this platform and the store has all the eCommerce features.
Revenue Management Consultancy Company | Data Integration
Delivered the data integration project, which involved developing an ADF pipeline, Azure Function, and C# Web API to integrate data—including invoice, sales, customer, product, and payment—from SAP IDoc XML, SFTP, CSV, and REST API to the Azure SQL Database. I also built pipelines to export the data for different clients in the retail FMCG industry.
Additionally, I created blob-triggered Azure Functions to transform XML data, including XSD validation and XSLT transformation, generating and sending output files to clients by API. I also designed the pipeline to ingest Excel and CSV files into the integration database, transforming and unpivoting the Excel data and exporting them to clients using ADF data flows.
Additionally, I created blob-triggered Azure Functions to transform XML data, including XSD validation and XSLT transformation, generating and sending output files to clients by API. I also designed the pipeline to ingest Excel and CSV files into the integration database, transforming and unpivoting the Excel data and exporting them to clients using ADF data flows.
Python IoT Project
Developed various Azure Functions as a Python IoT developer. Among these were Azure Functions that:
• Receive, validate, and process XML messages from IoT devices.
• Write and read data from Cosmos DB.
• Push messages to the Azure Storage Queue.
• Was triggered by Cosmos DB feed and Azure Storage Queue changes.
• Receive, validate, and process XML messages from IoT devices.
• Write and read data from Cosmos DB.
• Push messages to the Azure Storage Queue.
• Was triggered by Cosmos DB feed and Azure Storage Queue changes.
Skills
Languages
SQL, HTML, Stored Procedure, T-SQL (Transact-SQL), C#.NET, Python 3, Python, XML, Batch, JavaScript, Visual Basic for Applications (VBA), XSLT, XSD, Snowflake, Excel VBA
Tools
SQL Server BI, Microsoft Power BI, Microsoft Access, Microsoft Excel, Excel 2010, Azure Logic Apps, Tableau, BigQuery, Azure App Service, GitHub, Jira, Apache Airflow, Azure Machine Learning, Tableau Desktop Pro, Power Query, Google Analytics, Looker
Paradigms
Dimensional Modeling, Business Intelligence (BI), Database Design, ETL, OLAP, REST, Azure DevOps, Data Science
Platforms
Azure, Azure Functions, Google Cloud Platform (GCP), Databricks, Azure Event Hubs, Apache Kafka, Firebase
Storage
SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Azure SQL, Microsoft SQL Server, SQL Server Analysis Services (SSAS), Relational Databases, Databases, Data Pipelines, OLTP, Data Integration, Database Integration, Database Modeling, Database Migration, Database Lifecycle Management (DLM), SQL Stored Procedures, Azure Blobs, Azure SQL Databases, Data Lake Design, Data Lakes, Database Architecture, Azure Queue, SQL Server 2016, PostgreSQL, Redshift, Azure Cosmos DB, Database Administration (DBA), SQL Server DBA, NoSQL, MySQL, PL/SQL, Amazon S3 (AWS S3)
Other
Azure Data Factory, Data Modeling, Data Warehouse Design, Data Engineering, Data Warehousing, Data Migration, API Connectors, ETL Tools, Data Analytics, Data, Cloud Platforms, ELT, BI Reporting, SSRS Reports, Minimum Viable Product (MVP), Consolidation, Azure SQL Data Warehouse (SQL DW), Reporting, Data Cleansing, Data Quality Analysis, ETL Pipelines, Cloud, Entity Relationships, Performance Tuning, Azure Synapse, Azure Analysis Services, APIs, Dashboards, DAX, Data Visualization, Data Analysis, Webhooks, Cloud Migration, eCommerce, Financials, Big Data, Azure Databricks, Azure Stream Analytics, GloVe, Natural Language Processing (NLP), Data Architecture, Google BigQuery, Machine Learning, Azure Data Lake, GPT, Generative Pre-trained Transformers (GPT), SAP IDoc, Web Scraping, Data Scraping, Scientific Data Analysis, Excel Macros, Macros, SAP, Google Data Studio
Frameworks
Angular, Spark, .NET Core, Angular Material, ASP.NET Web API, Apache Spark, Hadoop
Libraries/APIs
ODBC, Pandas, Azure Cognitive Services, Azure API Management, Salesforce API, Stripe
Industry Expertise
Marketing
Education
1999 - 2003
Bachelor's Degree in Computer Science
Shijiazhuang Tiedao University - Hebei, China
Certifications
APRIL 2018 - PRESENT
Neural Networks and Deep Learning
Coursera
JUNE 2017 - PRESENT
MCSE: Cloud Platform and Infrastructure — Certified 2017
Microsoft