Allan Kote, Developer in East London, Eastern Cape, South Africa
Allan is available for hire
Hire Allan

Allan Kote

Bio

Allan is a senior data engineer and analytics engineer with extensive experience building enterprise analytics platforms, cloud data solutions, and scalable reporting ecosystems across financial services, telecommunications, healthcare, and enterprise environments. His expertise includes Microsoft Fabric, Snowflake, Databricks, Power BI, SQL, dbt, Azure Data Factory, ETL/ELT workflows, semantic modeling, and modern analytics engineering.

Portfolio

Freelance Clients
Data Scraping, Web Scraping, Scraping, Data Cleaning, Database Schema Design...
Guardian Restoration Partners Buyer, LLC - Main
Microsoft Power BI, Microsoft Fabric, Data Engineering, SQL...
Toptal Client
TIBCO, Snowflake, AWS Glue, Model Context Protocol (MCP), PySpark...

Experience

  • SQL - 18 years
  • Data Engineering - 17 years
  • Microsoft Power BI - 8 years
  • Data Build Tool (dbt) - 5 years
  • Snowflake - 2 years
  • Databricks - 2 years
  • Microsoft Fabric - 2 years

Preferred Environment

Microsoft Power BI, Microsoft Fabric, Snowflake, Databricks, SQL, Data Build Tool (dbt), Azure Data Factory (ADF), Cloud Analytics Platforms, Modern ELT/ETL Workflows

The most amazing...

...thing was building scalable enterprise analytics platforms that transform complex operational and financial data into trusted business insights.

Work Experience

Data Engineer, Reporting and Visualization Expert

2022 - PRESENT
Freelance Clients
  • Designed enterprise analytics and cloud reporting solutions using Microsoft Fabric, Snowflake, Power BI, SQL Server, dbt, Azure Data Factory, Databricks, and Python.
  • Built analytics-ready datasets, semantic models, and governed reporting environments supporting operational and executive decision-making.
  • Delivered reporting and analytics solutions for clients, including FIC, Point Broadband (USA), Wolf & Co. (USA), Fundi, Alexander Forbes, and C-Life (USA).
  • Implemented ETL/ELT workflows and scalable reporting ecosystems supporting financial reporting, KPI tracking, and operational analytics.
Technologies: Data Scraping, Web Scraping, Scraping, Data Cleaning, Database Schema Design, Database Normalization, Performance Optimization, Microsoft Fabric, ELT

Power BI/MS Fabric Developer

2026 - 2026
Guardian Restoration Partners Buyer, LLC - Main
  • Created and implemented a unified HR and payroll analytics data model in Microsoft Fabric, integrating ADP and SAGE workforce data into Gold-layer dimensional structures and fact tables to support enterprise workforce reporting and payroll analytics.
  • Enhanced and restructured Power BI semantic models and Direct Lake relationships to support cross-functional HR reporting, including payroll, workforce utilization, leave management, overtime analysis, and executive workforce dashboards.
  • Developed Spark-based employee reconciliation and identity matching logic across disparate HR systems, implementing robust matching, surrogate key strategies, and data quality controls to improve workforce data consistency and reporting reliability.
  • Designed custom monitoring and validation approaches for HR data pipelines and semantic model integrity, contributing to improved visibility into data quality and integration issues across shared enterprise reporting components.
Technologies: Microsoft Power BI, Microsoft Fabric, Data Engineering, SQL, Business Intelligence (BI), Fabric

TIBCO Specialist

2025 - 2025
Toptal Client
  • Designed and automated temporary Statistica workflows to extract and standardize complex production-inspired pharmaceutical data.
  • Built a scalable solution to migrate and document encrypted Statistica workflows, enabling full node logic extraction for auditability and regulatory compliance.
  • Engineered Python-driven automation to streamline statistical model execution and reporting, accelerating validation cycles for pharmaceutical analytics teams.
Technologies: TIBCO, Snowflake, AWS Glue, Model Context Protocol (MCP), PySpark, Amazon Web Services (AWS), Python, Data Scraping, Web Scraping, Scraping, Data Cleaning, Database Schema Design, Database Normalization, Performance Optimization, ELT

Data Engineer

2021 - 2025
Freelance Clients
  • Developed investment reports for Alexander Forbes using SQL Server Reporting Services (SSRS).
  • Outlined part of the ETL processes and automated jobs that feed into those investment reports.
  • Developed ETL processes and reporting for master data services targeting the Aurum Institute and PPECB.
  • Created data profiling scripts for RapidDeploy to be used on US 911 call data.
  • Used Databricks to ingest and process data from multiple heterogeneous sources, including APIs and relational databases. The solutions focused on reliability, performance optimization, and modular architecture.
Technologies: SQL Server Reporting Services (SSRS), Microsoft Power BI, SQL, Data Engineering, ETL, ETL Tools, Reports, Data Analytics, Data, Azure, Azure Databricks, Azure SQL, Data Warehouse Design, Windows PowerShell, CI/CD Pipelines, DevOps, Data Visualization, Microsoft Excel, Data Migration, Finance, Dashboards, Azure Data Explorer, Consulting, Data Architecture, Data Management, Data Pipelines, Databases, Relational Databases, Analytics, Scripting, OLAP, Data Warehousing, DAX, Financials, Reporting, Azure Data Lake, Azure SQL Data Warehouse, Dedicated SQL Pool (formerly SQL DW), Spark, PySpark, Databricks, BI Reporting, Data Modeling, Architecture, MySQL, Database Migration, Warehouses, Data Build Tool (dbt), Microsoft Data Transformation Services (now SSIS), Database Management, Sage, External Financial Reporting, Database Design, Relational Database Design, Database Architecture, ADP, JSON, ADP APIs, Sage ERP, API Integration, Postman, RESTFul APIs, Sage 300 SDK, ASP.NET, FTP, SFTP, VPN, Star Schema, Looker Studio, Data Quality Analysis, Data Cleaning, Database Schema Design, Database Normalization, Performance Optimization, ELT

Data Engineer

2024 - 2024
Wolf & Company, P.C.
  • Developed a data warehouse for a telco company in Snowflake with automated jobs. Thereafter, created Power BI reports with DAX formulas based on company KPIs.
  • Tracked bugs and resolved them while liaising with the client.
  • Ensure proper change management on GIT with team members.
Technologies: SQL, Data Engineering, Data Warehousing, Warehouses, Data Modeling, ETL, Data Pipelines, Azure, Snowflake, Data Build Tool (dbt), Data Scraping, Data Cleaning, Database Schema Design, Database Normalization, Performance Optimization, ELT

Deal Desk Technology Advisor

2023 - 2023
Zoetis - Net Revenue Management
  • Created a new advanced SQL script for tracking and calculating new ODx deals.
  • Developed a new ODBC dataset connection to access the SharePoint tracker spreadsheet.
  • Crafted a new paginated report to track sales and orders for new and existing ODx subscribers.
  • Used Azure Storage Explorer and Python to scrape invoices on PDFs and images.
  • Responded to the sales teams to recommend client offers based on the ODx tiering system.
Technologies: Business Services, Tableau, Microsoft Power BI, Data Analysis, Robotic Process Automation (RPA), Python, R, Azure Storage Explorer, Azure Data Factory (ADF), Azure Synapse, Reports, Data Analytics, Data, Azure, Azure Databricks, Azure SQL, Windows PowerShell, CI/CD Pipelines, DevOps, Data Visualization, Microsoft Excel, Data Migration, Finance, Dashboards, Azure Data Explorer, Consulting, Data Architecture, Data Management, Data Pipelines, Databases, Relational Databases, Analytics, Scripting, OLAP, Data Warehousing, DAX, Pricing, Financials, Reporting, Azure Data Lake, Dedicated SQL Pool (formerly SQL DW), Azure SQL Data Warehouse, BI Reporting, Data Modeling, Architecture, MacPractice, Database Migration, SQL, Warehouses, Data Build Tool (dbt), Database Management, Database Design, Relational Database Design, Database Architecture, ASP.NET, FTP, SFTP, VPN, Star Schema, Data Scraping, Web Scraping, Scraping, Data Cleaning, Database Schema Design, Database Normalization, Performance Optimization, ELT

Business Intelligence Developer and Data Engineer

2018 - 2021
inQuba
  • Developed customer analytics and enterprise reporting solutions using TIBCO Jaspersoft, Spotfire, SQL Server, and SSIS.
  • Designed dashboards and operational reports supporting customer engagement, service delivery, and CX analytics initiatives.
  • Built ETL workflows and staging environments supporting scalable analytics and reporting across multiple enterprise data sources.
Technologies: JasperSoft ETL, Data Engineering, Spotfire, Microsoft SQL Server, ETL, ETL Tools, Reports, Data Analytics, Data, Azure, Azure SQL, Data Warehouse Design, Amazon Web Services (AWS), DevOps, Data Visualization, Microsoft Excel, Data Migration, Finance, Dashboards, Consulting, Data Architecture, Data Management, Databases, Relational Databases, Analytics, MongoDB, MongoDB Atlas, Scripting, OLAP, Data Warehousing, DAX, Financials, Reporting, Azure Data Lake, Dedicated SQL Pool (formerly SQL DW), Azure SQL Data Warehouse, BI Reporting, Data Modeling, Architecture, MySQL, Database Migration, SQL, Warehouses, Microsoft Data Transformation Services (now SSIS), Database Management, Database Design, Relational Database Design, Database Architecture, ASP.NET, FTP, SFTP, VPN, Star Schema

Business Intelligence Developer and Data Engineer

2015 - 2018
Standard Bank South Africa
  • Developed South African Reserve Bank's regulatory reports for the finance department with SSRS.
  • Built SSIS packages for integrating data from various accounting and trading data sources into a central data warehouse. Used this main data warehouse as a data source for several regulatory report datasets.
  • Developed new ETL process status reports using Microsoft Power BI.
  • Navigated diverse databases like MongoDB, mastering NoSQL. Designed efficient solutions for varied applications using my proficiency in document-oriented, key-value, and graph models. Optimized data processes, ensuring high-performance systems.
Technologies: Computer Science, Microsoft Power BI, SQL Server Reporting Services (SSRS), Microsoft SQL Server, Data Engineering, ETL, ETL Tools, Reports, Data Analytics, Data, Azure, Azure Databricks, Azure SQL, Data Warehouse Design, DevOps, Docker, Data Visualization, Tableau, Microsoft Excel, Data Migration, Finance, Dashboards, Consulting, Data Architecture, Data Management, Java, Data Pipelines, Databases, Relational Databases, Analytics, NoSQL, Scripting, OLTP, OLAP, Data Warehousing, DAX, Financials, Reporting, Azure Data Lake, Azure SQL Data Warehouse, Dedicated SQL Pool (formerly SQL DW), BI Reporting, Data Modeling, Architecture, Database Migration, SQL, PostgreSQL, Warehouses, Microsoft Data Transformation Services (now SSIS), Database Management, External Financial Reporting, Database Design, Relational Database Design, Database Architecture, JavaScript, ASP.NET, FTP, SFTP, VPN, Star Schema

Business Intelligence Developer and Data Engineer

2014 - 2015
Telkom
  • Developed OSS/BSS and CRM system reports for consumer customer support with SSRS.
  • Developed ETL processes to integrate data from Telkom's various systems into a central reporting data warehouse. I would then use this data warehouse for business intelligence reporting.
  • Investigated and resolved anomalies in data reporting.
Technologies: SQL Server Reporting Services (SSRS), Microsoft SQL Server, SQL Server Integration Services (SSIS), Data Engineering, ETL, ETL Tools, Reports, Data Analytics, Data, Azure SQL, Data Warehouse Design, DevOps, Data Visualization, Microsoft Excel, Data Migration, Finance, Dashboards, Consulting, Data Architecture, Data Management, Databases, Relational Databases, Analytics, Scripting, PL/SQL, Oracle, OLTP, OLAP, Data Warehousing, DAX, Financials, Reporting, Dedicated SQL Pool (formerly SQL DW), Azure SQL Data Warehouse, BI Reporting, Data Modeling, Database Migration, SQL, Microsoft Data Transformation Services (now SSIS), Database Management, Database Design, Relational Database Design, Database Architecture, VPN, Star Schema

System Developer

2013 - 2014
Direct Transact
  • Developed banking system transactional components for branch treasury regulation using Transact-SQL.
  • Wrote code for transaction processing in Transact-SQL triggers and Delphi.
  • Investigated and resolved system-process anomalies.
Technologies: Delphi, Microsoft SQL Server, ETL, ETL Tools, Microsoft Excel, Finance, Consulting, .NET, Databases, Relational Databases, OLTP, OLAP, Database Migration, SQL, Microsoft Data Transformation Services (now SSIS), VPN

Business Intelligence Developer and Data Engineer

2012 - 2013
Telkom
  • Developed OSS, CRM, and BSS system reports for consumer customer support with SSRS.
  • Extracted, transformed, and loaded data from various sources to staging environments on Microsoft SQL Server using SSIS.
  • Investigated and resolved system and data reporting anomalies.
Technologies: Microsoft SQL Server, SQL Server Reporting Services (SSRS), Reports, Data Analytics, Data, Data Warehouse Design, Data Visualization, Microsoft Excel, Data Migration, Finance, Dashboards, Consulting, Data Architecture, Data Management, Java, Databases, Relational Databases, Analytics, Scripting, PL/SQL, Oracle, OLTP, OLAP, Data Warehousing, DAX, Data Modeling, Database Migration, SQL, Microsoft Data Transformation Services (now SSIS), VPN

Database Support

2012 - 2012
Turfsport
  • Provided database support for the company's integrated wagering solution.
  • Ensured triggers for betting processes worked as intended and at the precise time in the OLTP environment.
  • Investigated and resolved bets with unexpected results.
Technologies: Microsoft SQL Server, Microsoft Excel, Finance, Consulting, .NET, Databases, Relational Databases, Scripting, OLTP, OLAP, SQL, Microsoft Data Transformation Services (now SSIS), VPN

Business Intelligence Developer and Data Engineer

2004 - 2011
Telkom
  • Developed OSS/BSS and CRM system reports for consumer customer support with SSRS.
  • Signed a contract with Telkom to integrate legacy system data with new mobile network system data while the company was preparing to become a mobile network provider.
  • Developed C++, C#, VB.NET, Microsoft Access, and Oracle Application Express (APEX) applications to report network faults and manage fault activity proactively.
Technologies: Microsoft SQL Server, Oracle 10g, Oracle Reports, SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), C++, C#, VB.NET, Microsoft Access, Oracle 11g, Reports, Data Analytics, Data, Data Warehouse Design, Data Visualization, Microsoft Excel, Data Migration, Finance, Dashboards, Consulting, Data Architecture, Data Management, Databases, Relational Databases, Analytics, Scripting, PL/SQL, Oracle, OLTP, OLAP, Data Warehousing, DAX, SQL, VPN

Agent

2004 - 2004
Sishayele Contact Centre Solutions
  • Took emergency and police calls as an agent, providing the necessary information to emergency services.
  • Trained new colleagues on system usage and soft skills.
  • Captured and uploaded system data to be analyzed by the planning team.
Technologies: Customer Support, Microsoft Excel, Databases, OLAP, Data Warehousing, SQL

System Developer

2002 - 2003
Soluziona Professional Services
  • Wrote an ICS security application in PowerBuilder and C.
  • Developed a reports module for the application using Oracle Report Writer.
  • Created system batch jobs in C and PL/SQL for overnight execution.
Technologies: C, Oracle Reports, PowerBuilder, PL/SQL, Reports, Data Analytics, Data, Data Visualization, Microsoft Excel, Data Migration, Finance, Consulting, Databases, Relational Databases, Oracle, OLTP, OLAP

System Developer

2000 - 2002
Touchstone Computer Systems
  • Developed new functionality for the Payplus payroll system in Visual Basic for MS-DOS.
  • Built an HR data capturing application to store the historical data of employees in Q&A.
  • Created a system to automatically print cheques an operator has entered in Q&A.
Technologies: VB, Human Assessment, OLTP, OLAP, Data Warehousing, Human Resources (HR)

Experience

Master Data Services for the Perishable Products Export Control Board

Contributed to the cleanup of the government entity's master data by scripting ETL processes to move dimension data from its legacy system, Titan. Scripts are dynamic, done in Transact-SQL, run from SSIS packages, and are loaded on a Master Data Services (MDS) data warehouse. The packages also activate leaf-stored procedures that ensure the integrity of the master data in preparation for Dynamix 365 integration.

Emergency Call Center Data Engineering

As a central back-end data engineer, I profiled and structured 911 call center data from various US states. My primary value has been creating automated unit tests to automatically detect anomalies in the data to maintain its integrity.

Financial Data Warehousing

http://www.fundi.co.za
I led data integration efforts within Fundi to keep everything within a centralized data warehouse on Azure. Fundi provides funding for higher education. I built ETL processes to move data from various systems and sources.

Education

2020 - 2020

Postgraduate Program in Artificial Intelligence and Machine Learning

The University of Texas - Austin, USA

2005 - 2014

Bachelor's Degree in Computer Science

University of South Africa - Pretoria, South Africa

2008 - 2010

Advanced Diploma in Telecommunications

Rhodes University | Institute for Technology and Strategy Innovation (ITSI) - Pretoria, South Africa

2008 - 2008

Advanced Diploma in Operations Management

North-West University - South Africa

1999 - 2000

Vocational Diploma in Computer Science

Genetic Computer School - Gaborone, Botswana

Certifications

SEPTEMBER 2017 - PRESENT

Microsoft Certified Professional

Microsoft

DECEMBER 2010 - PRESENT

ITIL Certification

EXIN Cape Town

Skills

Libraries/APIs

PySpark, Sage, ADP APIs, Fabric

Tools

Microsoft Power BI, Spotfire, JasperSoft ETL, Tableau, Microsoft Excel, VPN, Oracle Reports, Microsoft Access, Looker, Azure Data Explorer, Apache Airflow, MongoDB Atlas, Postman, Sage 300 SDK, AWS Glue, Git

Languages

Transact-SQL (T-SQL), SQL, Snowflake, Delphi, C++, C#, VB.NET, C, PowerBuilder, VB, Python, Java, R, JavaScript

Storage

Relational Databases, Microsoft SQL Server, SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), PL/SQL, Azure SQL, Databases, Database Migration, Database Management, Database Architecture, Oracle 10g, Oracle 11g, Data Pipelines, NoSQL, MongoDB, OLTP, MySQL, PostgreSQL, Cloud Firestore, JSON

Frameworks

ASP.NET, Windows PowerShell, .NET, Spark

Paradigms

Business Intelligence (BI), ETL, OLAP, Database Design, DevOps, Model Context Protocol (MCP), Requirements Analysis

Platforms

Azure Synapse, Oracle, Azure SQL Data Warehouse, Databricks, Dedicated SQL Pool (formerly SQL DW), Microsoft Fabric, Azure, Amazon Web Services (AWS), Docker

Industry Expertise

Accounting

Other

Reporting, Data Engineering, Data Analysis, Data Analytics, Data, Data Warehouse Design, Data Migration, Finance, Dashboards, tSQLt, ETL Tools, Consulting, Data Architecture, Data Management, Analytics, Azure Data Factory (ADF), Scripting, Data Warehousing, DAX, Azure Data Lake, BI Reporting, Data Modeling, Warehouses, Data Build Tool (dbt), Microsoft Data Transformation Services (now SSIS), Relational Database Design, Metabase, FTP, SFTP, Star Schema, Data Quality Analysis, Data Scraping, Web Scraping, Scraping, Data Cleaning, Database Schema Design, Database Normalization, Performance Optimization, ELT, Machine Learning, Computer Science, ITIL V3 Foundation Certified, Next-generation Networks (NGN), Operations, Business, Customer Support, Human Assessment, Microsoft Master Data Services (MDS), Reports, Azure Databricks, CI/CD Pipelines, Data Visualization, Business Services, Robotic Process Automation (RPA), Azure Storage Explorer, Pricing, Financials, Architecture, MacPractice, Enterprise Resource Planning (ERP), Human Resources (HR), External Financial Reporting, ADP, Sage ERP, API Integration, RESTFul APIs, Looker Studio, TIBCO, Performance Tuning, Cloud Analytics Platforms, Modern ELT/ETL Workflows, SQL Server, UAT Support

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring