Senior Data Consultant (Analytics Engineer)
2022 - PRESENTDiscovery Parks- Designed a data platform architectural strategy to enable deep analytics of customer data, marketing automation, and the attribution of online and offline activity, presented to and accepted by the CTO and senior managers.
- Documented, designed, and developed a tactical platform based on my proposal using Azure Data Lakes, Synapse serverless, and virtual data marts to enable rapid development and prototyping of data models via dbt and visualization in Power BI.
- Iterated the tactical model into an enterprise solution underpinned by a Databricks data lakehouse (delta lake) with dbt used to deploy the now more mature data models.
Technologies: Azure, Azure Synapse, Azure Data Lake, Azure Data Factory, Databricks, Data Build Tool (dbt), Microsoft Power BI, Python, Data Visualization, SQL, ELT, ETL, ETL Tools, Delta Lake, Data Lakehouse, Data Marts, Kimball Methodology, Azure SQL, Azure SQL Databases, Dimensional Modeling, Data VaultsSenior Data Engineer - Global Laboratory & Analytics Company
2022 - 2023Tentamus Group GmbH - Main- Designed and developed a data mart to allow faster and deeper reporting for internal and external stakeholders by combining multiple data sources from the various international labs run by Tentamus.
- Ran training sessions to train the data science team on the administration and management of the data platform.
- Scaled platform by onboarding additional datasets from existing data sources and provisioning new data sources.
- Provided additional support and feature enhancement for the data platform.
Technologies: SQL, Data Engineering, Data Warehousing, Data Mining, Python, Microsoft Power BI, ETL, Dataflow ProgrammingData and Analytics Developer
2021 - 2022Elders Rural- Provided expertise and advice on an Azure cloud PoC data lake implementation project to support greater analytics by integrating Elders Rural core financial data with that of other business entities acquired by Elders.
- Built integration pipelines in just a few days to replace non-functional pipelines that had months of work.
- Created a certificate-based JWT authentication to allow seamless integration to a data source.
- Developed, designed, and implemented solutions using Azure Synapse (pipelines, data flows, serverless) and Databricks.
Technologies: Azure, Azure Synapse, Databricks, Azure Data Factory, Microsoft SQL Server, SQL, Database Design, ETL, ELT, Python, Data Engineering, Data Warehousing, Business Intelligence (BI), Business Intelligence Architecture, Data Warehouse Design, T-SQL, Azure SQL, Data Architecture, Data Integration, Data Marts, Azure SQL Databases, Business Intelligence (BI) Platforms, ETL ToolsSenior Data Engineer
2021 - 2022Tentamus- Analyzed the company's existing data warehousing solution architecture, provided feedback, and wrote a proposal for a new solution and approach.
- Designed and developed a PoC data mart based on the proposal to allow faster and deeper reporting for internal and external stakeholders by combining multiple data sources from the various international labs run by Tentamus.
- Wrote and ran training sessions for the data science time on how to use and add new data sources to the data mart.
Technologies: Microsoft SQL Server, SQL Server Integration Services (SSIS), SQL, ETL, ELT, Database Design, Data Engineering, Data Warehousing, Business Intelligence (BI), Database Architecture, Business Intelligence Architecture, Data Warehouse Design, T-SQL, Python, Data Architecture, Data Integration, Data Marts, Business Intelligence (BI) Platforms, ETL ToolsData and Analytics Developer
2020 - 2021Australian Rail Transport Corporation- Provided support in integrating and implementing ARTC's asset management support capabilities, such as improved work planning and evidence-driven proactive asset maintenance based on exceptions, trends, and predictions.
- Designed, developed, and migration of integration data models using Azure Synapse and Parallel data warehouse, Azure Databricks, and Azure Data Factory.
- Provided capability to the corporate services team to migrate a traditional ETL-driven data architecture to an Azure hybrid cloud solution.
Technologies: Data Build Tool (dbt), Microsoft SQL Server, Azure, Databricks, Azure Synapse, SQL, SQL Server Integration Services (SSIS), Tableau, Reports, Microsoft Power BI, Dashboards, Data Visualization, Database Design, Star Schema, Data Engineering, Data Warehousing, ETL, Business Intelligence (BI), Database Architecture, Dashboard Design, Business Intelligence Architecture, Data Warehouse Design, T-SQL, Power Pivot, Azure SQL, Data Architecture, Dashboard Development, Data Integration, SSAS Tabular, Embedded Business Intelligence, DAX, Data Marts, ELT, Azure SQL Databases, Business Intelligence (BI) Platforms, ETL ToolsData and Analytics Developer and Architect
2019 - 2021Aircraft Hardware West- Collaborated with senior management to architect and develop inventory management analytics to streamline analysis and forecasting of demand and stock levels to allow AHW to meet contractual SLAs and required stock on hand levels.
- Loaded, integrated, and modeled disparate data sources and reference data using ELT and a relational data lake approach using Pentaho and SQL Server.
- Designed and built a suite of dashboards in Power BI to visualize findings, forecasts, and historical trends and allow further what-if analysis.
- Implemented statistical models to surface complex domain-specific attributes like safety stock and economic order quantity.
- Designed, documented, and built dimensional star schema models to enable complex analysis.
Technologies: Microsoft Power BI, Microsoft SQL Server, Oracle, Data Visualization, Dashboards, Star Schema, ELT, ETL, Data Engineering, Data Warehousing, SQL, Business Intelligence (BI), Database Architecture, Dashboard Design, Business Intelligence Architecture, Data Warehouse Design, T-SQL, Power Pivot, Data Architecture, Dashboard Development, Data Integration, SSAS Tabular, Embedded Business Intelligence, DAX, Data Marts, Business Intelligence (BI) Platforms, ETL ToolsBI Developer and Architect
2018 - 2019Department of Health (South Australia)- Completed a short-term contract within the system performance and service delivery team providing capability ETL design and development, solution architecture, and data warehouse architecture.
- Acted as the architect and built a modular ELT framework using SSIS and SQL to productionize a Qlik Sense-based proof of concept solution.
- Reverse-engineered Qlik script and migrated it into an ELT framework and the interface into the enterprise data warehouse.
Technologies: Qlik Sense, SQL Server Integration Services (SSIS), SQL, ETL, ELT, Data Engineering, Data Warehousing, Microsoft SQL Server, Business Intelligence (BI), T-SQL, Data Architecture, Data Integration, Data Marts, Azure SQL Databases, Business Intelligence (BI) Platforms, ETL ToolsHead of Technology, Architect, and Business Intelligence Consultant
2015 - 2019Laneway Analytics- Served as the project owner for Luci, our data analytics platform that Laneway built to help users engage with analytics more quickly and naturally. Used Agile and Scrum.
- Developed Luci, a SPA running on AWS with a React front end, .NET Core, PostgreSQL, and Tableau as the data visualization layer. The analytics component is built using S3, Redshift, Redshift Spectrum, and columnstore SQL Server.
- Acted as the principal data architect at Laneway for our most important clients. Using my Agile approach to data integration and data modeling, I proved that a data warehouse could be functional within weeks, not months or years.
- Developed a complex financial analysis tool utilizing an SQL Server OLAP cube as a calculation engine and Tableau as the visualization layer.
- Delivered rapid architecture, design, and development of a number of tactical data marts built-in SQL server and Redshift for large clients in logistics, manufacturing, and finance. Integrated and modeled data with a logical view ELT-based approach.
Technologies: Amazon Web Services (AWS), .NET, Azure, Amazon S3 (AWS S3), Tableau, SSAS, SSRS, SQL Server Integration Services (SSIS), PostgreSQL, Redshift, Microsoft SQL Server, ETL, ELT, Databases, DataViz, Data Visualization, Dashboards, Star Schema, Data Engineering, Data Warehousing, SQL, Business Intelligence (BI), Database Architecture, SQL Server Analysis Services (SSAS), Microsoft Power BI, Dashboard Design, Business Intelligence Architecture, Data Warehouse Design, T-SQL, Azure SQL, Python, Data Architecture, Dashboard Development, Data Integration, Embedded Business Intelligence, MDX, Data Marts, Business Intelligence (BI) Platforms, ETL ToolsSenior Business Intelligence Consultant and Data Architect
2011 - 2015Chamonix- Designed and developed enterprise data warehouse solutions that spanned the full Microsoft BI stack, including data store, integration, data models, and visualizations for numerous clients across the government, health, education, and utilities sector.
- Mapped out and created numerous complex SSAS OLAP solutions utilizing multidimensional and tabular, including Power Pivot.
- Planned and developed an SSIS-based modular ETL framework that integrated data from various RDBMS (Oracle and SQL Server), flat file, and web-based data sources. The framework was successfully deployed to numerous clients.
- Outlined and developed a SQL Server data warehouse for a financial reporting and forecasting tool for a major utility provider in Australia.
- Designed and developed a SQL Server data warehouse featuring a real-time, shift, and historical reporting dashboard solution for ambulance emergency response. Near-real-time data is visualized for the commanders at the incident response center.
- Developed a suite of 30+ complex KPI, financial, and operational reports for a public utility company. Completed in under a month, allowing the project to go live on schedule after IBM had de-scoped the vital reporting assets.
- Provided pre-sales and proof of concept and prototyping support to the sales team to win new business.
- Worked closely with business stakeholders to analyze requirements and provide sound solutions.
- Developed and deployed a number of analytics PoC solutions in Azure for client projects using Azure SQL and Power BI.
Technologies: Amazon Web Services (AWS), .NET, Azure, BIRT, Visual Basic for Applications (VBA), Power Pivot, Microsoft Excel, Microsoft Power BI, SSAS, SSRS, SQL Server Integration Services (SSIS), Microsoft SQL Server, Business Intelligence (BI), Dashboards, Data Visualization, SQL, T-SQL, MDX, DAX, Data Modeling, Database Design, Star Schema, Data Engineering, Data Warehousing, ETL, Database Architecture, SQL Server Analysis Services (SSAS), Dashboard Design, Business Intelligence Architecture, Data Warehouse Design, SQL Server Reporting Services (SSRS), Azure SQL, Data Architecture, Dashboard Development, Data Integration, SSAS Tabular, Embedded Business Intelligence, Data Marts, ELT, Azure SQL Databases, Business Intelligence (BI) Platforms, ETL ToolsBusiness Intelligence Developer and Data Architect
2011 - 2011Department of Business and Innovation (Victoria)- Created SSIS-driven ETL framework for reporting Australian Vocational Education and Training Management Information Statistical Standard (AVTEMISS) compliant training activity data to the National Centre for Vocational Education Research (NCVER).
- Built metadata-driven ETL (SSIS) and reporting suite (SSRS) for data reconciliation reporting between source systems, data warehouse (SQL Server), and OLAP cubes (SSAS).
- Developed lightweight optimized training activity analysis services multidimensional OLAP cube for faster reporting of commonly used measures for consumption via Excel reporting packs and self-service.
Technologies: Microsoft Excel, MDX, SSAS, SQL Server Integration Services (SSIS), T-SQL, Business Intelligence (BI), Data Engineering, Data Warehousing, Microsoft SQL Server, Data Visualization, SQL, ETL, SQL Server Analysis Services (SSAS), Dashboard Design, Data Warehouse Design, Data Architecture, Dashboard Development, Data Integration, Data Marts, Business Intelligence (BI) Platforms, ETL ToolsAnalyst, Programmer, and Data Architect
2011 - 2011Department of Education (Victoria)- Developed and deployed a centralized single source of truth of school-based reference data for application use.
- Designed and built a multi-faceted data integration process, including change data capture, SQL replication from Oracle and old versions of SQL Server to a centralized SQL Server, and integration services.
- Oversaw the analysis and architecture of the centralized SQL Server database, including all architectural documentation and code implementation, and consolidation of existing reference databases.
- Implemented SQL Server schema-based security to lock down student reference data.
Technologies: CDC, SQL Server Integration Services (SSIS), T-SQL, Microsoft SQL Server, Databases, Database Design, SQL, ETL, Business Intelligence (BI), Data Integration, Business Intelligence (BI) Platforms, ETL ToolsData Warehouse Developer
2010 - 2010Link Group- Migrated superannuation customer data from an AS/400 source to SQL Server data warehouse.
- Designed and developed a generic SSIS ETL metadata-driven framework for generating extracts and delivering via SFTP B2B link to AMP.
- Fixed, enhanced, and created new dashboards and reports for the SQL Server Reporting Services report pack sent out to customers.
Technologies: SSRS, SQL Server Integration Services (SSIS), T-SQL, Microsoft SQL Server, Reporting, Data Engineering, Data Warehousing, Data Visualization, SQL, ETL, Business Intelligence (BI), Database Architecture, Dashboard Design, Data Warehouse Design, SQL Server Reporting Services (SSRS), Data Architecture, Dashboard Development, Data Integration, Data Marts, Business Intelligence (BI) Platforms, ETL ToolsDatabase Administrator
2008 - 2010Building and Plumbing Commission (Victoria)- Managed the SQL Server environment at the Building and Plumbing Commission (Victoria) as the DBA, including backup and restore, performance, and disaster recovery on a few occasions.
- Identified timing issues with existing backup plans that had invalidated all point-in-time backups; created a new backup process and ran restore scenarios weekly.
- Debugged, profiled, and queried optimization of database applications that used SQL Server as their data tier.
- Wrote a database consolidation plan for management.
- Advised management of risks, data costs, and feasibility of proposed third-party vendor applications in relation to SQL Server.
Technologies: T-SQL, SQL Server Integration Services (SSIS), Microsoft SQL Server, Databases, Database Administration (DBA), SQL, ETL, Database Architecture, SQL Server Reporting Services (SSRS), Data Integration, ETL ToolsAnalyst and Programmer | Data Migration
2008 - 2008National Australia Bank- Contributed to a large project to roll out a third-party solution to replace a legacy in-house product used for managing unit pricing for superannuation products.
- Migrated historical data and implemented the new solution within the existing National Custodial Services (NCS) framework.
- Updated the profile data in the Oracle database and wrote SQL migration scripts.
- Used DataStage to create and orchestrate data migration processes.
Technologies: Datastage, Visual FoxPro, Oracle, SQL, ETL, Data Integration, ETL ToolsSenior Analyst and Programmer | Database
2007 - 2007Department of Health (South Australia)- Developed a 3-tier enterprise-level community healthcare application using Visual FoxPro and SQL Server. I was involved in the entire lifecycle of the product, including front-end and database analysis, development, and optimization.
- Designed and developed a scheduling module using Visual FoxPro and SQL Server.
- Rewrote the address lookup when a patient presented at a hospital. The original screen had 30+ text boxes. The new version had a single text box and used custom fuzzy logic to create a ranked list of possible matches from an address lookup whitelist.
- Performed database and query optimization using SQL Query profiling and index optimization.
Technologies: XML, SSRS, Crystal Reports, SQL Server Integration Services (SSIS), T-SQL, Microsoft SQL Server, Reports, Databases, Database Design, Query Optimization, SQL, ETL, Database Architecture, Data Integration, ETL ToolsDatabase Conversion Analyst
2007 - 2007Department of Further Education, Employment, Science and Training (South Australia)- Served as the technical lead on data migration from legacy system to 3-tier distributed architecture.
- Performed a gap analysis of before and after data models and created data mapping tables and complex SQL data migration procedures.
- Created orchestration ETL process in SSIS to perform the data migration.
Technologies: T-SQL, SQL Server Integration Services (SSIS), Microsoft SQL Server, Data Migration, SQL, ETL, Data Integration, ETL ToolsSenior Analyst and Programmer | Data Migration
2006 - 2006Department of Health (South Australia)- Acted as the technical lead on multi-site data migration from a legacy FoxPro system into a centrally hosted 3-tier enterprise-level solution.
- Developed and executed the migration plans and tools.
- Created a generic repeatable ETL process in DTS/SSIS to perform the data migration.
- Oversaw the data mapping, validation, gap analysis, and cleansing using SQL Server.
- Liaised with each hospital administration team to write test plans, validate trial migrations, and organize the production migrations.
- Trained hospital staff on the use of the new system.
- Rewrote and refactored Crystal Reports and SQL data exports.
Technologies: XML, SSRS, Crystal Reports, SQL Server Integration Services (SSIS), T-SQL, Microsoft SQL Server, Data Migration, Reporting, SQL, ETL, Database Architecture, Data Integration, ETL ToolsProgrammer
2004 - 2006Steadfast Australia- Developed and implemented a middleware solution that integrated orders on the web portal with the in-house FoxPro-based tracking system and external transport companies to generate pack orders and print shipping labels.
- Created and supported a web-based portal for customer orders using PHP and MySQL.
- Built financial and operational reporting solutions within TransLogix, the warehouse stock management system.
- Developed end-to-end integration between the order entered on the web portal and the products picked for shipping. Created custom barcodes so workers could use handheld scanners to update workflow status without typing.
Technologies: Visual FoxPro, Microsoft Excel, SQL, MySQL, PHP, Dashboards, Reports, Data IntegrationDatabase Developer
2004 - 2004Origin Energy- Developed a MS Access-based application to create a searchable index of technical drawing of all assets at a number of power plants.
Technologies: Microsoft Access, SQL