Allan Carruthers, Developer in Vancouver, BC, Canada
Allan is available for hire
Hire Allan

Allan Carruthers

Verified Expert  in Engineering

Business Intelligence Developer

Location
Vancouver, BC, Canada
Toptal Member Since
February 22, 2022

Allan is a seasoned data engineer and developer with 17 years of experience building elegant and creative products and services that make customers happy. He has delivered over 100 successful projects for his body of Fortune 1000 clientele. A specialist in business intelligence, systems integration, and application development, Allan continually solves complex problems as an entrepreneur, architect, designer, and implementer.

Portfolio

Salient Business Intelligence
SAP BusinessObjects (BO), SAP BusinessObjects Data Service (BODS)...
Livedocs
Node.js, Python, TypeScript, Fivetran, PostgreSQL, Google BigQuery...
Kanary
Node.js, React, React Redux, Express.js, TypeScript, PostgreSQL, Redis, HTML5...

Experience

Availability

Full-time

Preferred Environment

Windows, Linux

The most amazing...

...thing I've developed is Kanary, an employee fraud-mitigation product for small businesses, where I've designed and implemented the entire technology stack.

Work Experience

Senior Business Intelligence Consultant

2007 - PRESENT
Salient Business Intelligence
  • Aided 100+ clients to design and implement robust data pipelines to fulfill downstream business intelligence and operational needs using SAP Data Services, Microsoft SSIS, and custom development.
  • Led and assisted enterprise clients in delivering and integrating end-to-end technology solutions using the SAP BusinessObjects suite of products, coupled with IT architectures that spanned most technology stacks and industry verticals.
  • Learned quickly and became effective in any product or technology that enabled delivering solutions and client success.
  • Re-engaged by clients to assist with multi-year projects based on the history of delivering high-quality, successful work.
Technologies: SAP BusinessObjects (BO), SAP BusinessObjects Data Service (BODS), Web Intelligence, Crystal Reports, C#.NET, Java, Oracle, IBM Db2, Microsoft SQL Server, Data Migration, JavaScript, HTML, CSS, SAP LSMW Data Migrations, HTML5, ETL, Data Architecture, Architecture, Consulting, Relational Databases, SQL, SQL Server Integration Services (SSIS), PHP, ETL Development, SAP HANA, Data Warehouse Design, Datasets, Databases, Python, Business Intelligence (BI), SQL Stored Procedures, Dashboards, Data Warehousing, Data Analysis, Data Engineering, Data Modeling, SAP, Data Analytics, API Connectors, Data Cleansing, Data Cleaning, XML, JSON, C#, APIs, Stored Procedure, T-SQL (Transact-SQL), Google Analytics, Consumer Packaged Goods (CPG), Dimensional Modeling, Microsoft Power BI, REST APIs, Windows, Linux, Ubuntu Linux, Azure, Migration, Star Schema, ETL Tools, Google Sheets, Data Visualization, CSV, Microsoft Excel, Full-stack, MySQL, Data Pipelines, QuickBooks Online, Data Integration, Postman, API Integration, Entrepreneurship, Investment Banking, Finance, Web Services, Database Architecture, Database Design, ETL Implementation & Design, API Architecture, Logistics, DAX, Power Query, Scripting Languages, Looker, Dashboard Design, BigQuery, SQL Server Reporting Services (SSRS), Reporting, Data Fetching, Data Scraping, Airtable, Salesforce

Data Engineer | Data Integration Specialist | Node.js Back-end Developer

2023 - 2024
Livedocs
  • Architected and implemented the core data integration layer, enabling Livedocs users to sync metrics and data from popular cloud applications like Facebook Ads, Shopify, and Segment to internal data repos for consumption by the Livedocs application.
  • Developed and implemented a metrics service that aggregated relevant user metrics based on connected integrations. Continuously compiled metrics were utilized by front-end reporting, dashboards, and alerts.
  • Created a data service enabling users to configure report specifications via the front end. Generated optimized SQL queries to retrieve the necessary data and packaged it into a format suitable for front-end visualizations.
  • Developed a natural language querying service that used GPT-4, Pinecone, and local metadata to translate user data questions via Slack and within the Livedocs application into SQL queries that returned data that answered the questions.
Technologies: Node.js, Python, TypeScript, Fivetran, PostgreSQL, Google BigQuery, Google Cloud Platform (GCP), Vercel, Next.js, Redis, OpenAI, OpenAI GPT-3 API, OpenAI GPT-4 API, OpenAI Assistants API, Pinecone, SQL, Slack API, Express.js, GraphQL, Apollo Server, Sequelize, Fastify, Google Pub/Sub, Natural Language Queries, LinkedIn API, Reply.io API, Facebook Ads API, Google Analytics API, GitHub API, HubSpot API, TikTok Ads, Shopify API, Twitter API, SendGrid API, Instagram API, Segment.io API, GitHub, Jest, Playwright, Radar, Stripe API, Reddit API, Lerna, Salesforce

Co-founder | CTO

2020 - 2024
Kanary
  • Designed and implemented the back end and analytics engine with various technologies, including Node.js, Express, and PostgreSQL.
  • Built and implemented automated, parallelized data pipelines in Node.js using BullMQ, Redis, and PostgreSQL. The resulting system ingested QuickBooks Online data and transformed it into an agnostic format for analysis by the analytics engine.
  • Created and implemented intuitive and effective UI/UX using Node.js, React, Redux, TypeScript, HTML5, and CSS.
  • Developed integrations with 3rd-party vendors such as Stripe, QuickBooks Online, SendGrid, and Google Analytics.
  • Collaborated with the beta customers to refine UI/UX using Figma and rapid prototyping.
  • Developed and executed marketing and sales strategies to facilitate growth.
Technologies: Node.js, React, React Redux, Express.js, TypeScript, PostgreSQL, Redis, HTML5, CSS, NGINX, Ubuntu Linux, Stripe API, QuickBooks API, SendGrid API, Google Analytics API, HTML, Data Architecture, Architecture, Relational Databases, SQL, Adobe Photoshop, ETL Development, Datasets, Databases, Business Intelligence (BI), Dashboards, Data Warehousing, ETL, Data Warehouse Design, Data Analysis, Data Engineering, Data Modeling, Data Analytics, API Connectors, JSON, APIs, Google Analytics, Dimensional Modeling, REST APIs, Windows, Linux, Migration, Star Schema, ETL Tools, Data Visualization, CSV, Microsoft Excel, Full-stack, Data Pipelines, QuickBooks Online, Data Integration, Postman, API Integration, Entrepreneurship, Database Architecture, Database Design, ETL Implementation & Design, API Architecture, Scripting Languages, Dashboard Design, Reporting, Data Fetching, Data Scraping

Senior Data Engineer | Data Warehouse Architect

2022 - 2022
Insurance Proz Solutions, LLC
  • Architected and implemented the extraction, load, and transformation of disparate data into a powerful, consolidated data store representing the single source of truth for company metrics.
  • Implemented robust, autonomous data pipelines using Python and third-party tools that continuously extracted and loaded large volumes of data from REST APIs, MySQL, and flat files into BigQuery for further analysis.
  • Designed and implemented on-demand dashboards in Looker that enabled the client to have a consolidated view of operational and financial performance. KPI turnaround time was reduced from half a day to seconds.
  • Oversaw the discovery and evaluation of third-party ELT, ETL, reporting, and data warehousing technology stacks, allowing the client to achieve a solution with a winning balance of product functionality, cost, and scalability.
Technologies: Data Engineering, Data Warehouse Design, Data Warehousing, Google BigQuery, Data Modeling, Business Intelligence (BI), Hevo Data, ELT, ETL, Python, MySQL, REST APIs, Google Cloud Platform (GCP), Fivetran, Rivery, Cloud Data Fusion, Xplenty, Integrate.io, APIs, BigQuery, Looker, Dimensional Modeling, Azure Data Lake, Azure, JSON, API Connectors, Google Cloud, Windows, ETL Development, Data Migration, Databases, SQL, Relational Databases, Migration, Matillion, Star Schema, ETL Tools, Google Sheets, Data Visualization, CSV, Microsoft Excel, Data Pipelines, Data Integration, Postman, API Integration, Database Architecture, Database Design, ETL Implementation & Design, API Architecture, DAX, Power Query, Scripting Languages, Dashboard Design, Reporting, Data Fetching, Airtable

Data Engineer

2022 - 2022
medONE Corporation
  • Worked in a distributed team to develop an electronic document interface (EDI) billing document analysis pipeline and engine in Python that aimed to catch errors, reduce insurance provider rejections, and improve cash flow for medical practices.
  • Interfaced with and developed unit tests for a minimally documented 3rd-party EDI billing analysis API, a key component of the in-house solution.
  • Debugged and troubleshot existing problematic code to assist data scientist productivity.
Technologies: ETL, SQL, Data Pipelines, Data Engineering, Python, Spark, Selenium, Pandas, NumPy, Beautiful Soup, Amazon Web Services (AWS), APIs, REST APIs, JSON, API Connectors, Linux, ETL Development, Databases, CSV, Data Integration, Postman, API Integration, API Architecture, Scripting Languages, Reporting, Data Fetching, Data Scraping

Senior Business Intelligence Consultant

2016 - 2021
Cleveland-Cliffs
  • Oversaw BI aspects of the company-wide ERP upgrade, focusing on the ETL process, upgrade, testing, and rollout.
  • Reduced the turnaround time for management and departmental users by delivering accurate, timely information via Web Intelligence (WEBI) reports and underlying data processes.
  • Managed the implementation of the ETL process conversion to implement best practice methodologies around reliability and performance.
  • Expanded data access and quality by maintaining existing Oracle data warehouse initiatives and architecting new ones.
  • Improved the data quality and reliability through implementing best practice configuration management, testing, and validation for ETL processes across various environments.
  • Worked with various internal companies and departments to successfully architect and implement custom analytic applications that improved data access and reduced IT dependency.
  • Worked with disparate internal companies to design and implement unique data pipelines that fed into central data stores to give senior management a reliable, consolidated view of company operations.
Technologies: SAP BusinessObjects (BO), SAP BusinessObjects Data Service (BODS), Web Intelligence, Oracle, Microsoft SQL Server, Data Warehousing, Database Migration, Data Migration, HTML, ETL, Data Architecture, Architecture, Consulting, Relational Databases, SQL, SQL Server Integration Services (SSIS), ETL Development, Data Warehouse Design, Datasets, Databases, Business Intelligence (BI), SQL Stored Procedures, Dashboards, Data Analysis, Data Engineering, Data Modeling, Data Analytics, Data Cleansing, Data Cleaning, JSON, Stored Procedure, T-SQL (Transact-SQL), Dimensional Modeling, Microsoft Power BI, Windows, Migration, Star Schema, ETL Tools, Data Visualization, CSV, Microsoft Excel, Data Pipelines, Data Integration, Entrepreneurship, Finance, Database Architecture, Database Design, ETL Implementation & Design, API Architecture, Logistics, DAX, Power Query, Scripting Languages, Dashboard Design, Reporting, Data Fetching, Data Scraping

Senior Business Intelligence Consultant

2015 - 2021
Marcus & Millichap
  • Expanded the company data access and quality by maintaining the existing and developing new ETL functionality using SQL Server, SAP Data Services, and SAP R/3.
  • Streamlined the existing and developed new, highly-visible, and actionable financial reports for senior management.
  • Empowered the senior financial staff to have timely access to the secure, personalized, regional performance data via a custom-developed report generation and distribution application.
  • Reduced the user dependence on IT analysts by designing and developing a self-serve, custom portal in C# .NET for sales agents to access performance and commission metrics.
Technologies: C#.NET, SAP BusinessObjects (BO), Crystal Reports, SAP BusinessObjects Data Service (BODS), Microsoft SQL Server, ASP.NET, SAP R/3, Data Migration, HTML, JavaScript, CSS, HTML5, ETL, Data Architecture, Architecture, Consulting, Relational Databases, SQL, SQL Server Integration Services (SSIS), ETL Development, Data Warehouse Design, Datasets, Databases, Business Intelligence (BI), SQL Stored Procedures, Dashboards, Data Warehousing, Data Analysis, Data Engineering, Data Modeling, SAP, Data Analytics, API Connectors, Data Cleansing, Data Cleaning, XML, JSON, C#, APIs, Stored Procedure, T-SQL (Transact-SQL), Dimensional Modeling, Windows, Migration, Star Schema, ETL Tools, Data Visualization, CSV, Microsoft Excel, Full-stack, Data Pipelines, Data Integration, API Integration, Entrepreneurship, Microsoft Power BI, Finance, Database Architecture, Database Design, ETL Implementation & Design, API Architecture, DAX, Power Query, Scripting Languages, Dashboard Design, SQL Server Reporting Services (SSRS), Reporting, Data Fetching, Data Scraping

Senior Business Intelligence Consultant

2014 - 2015
Veolia
  • Migrated master data elements from disparate legacy systems to SAP in collaboration with various internal companies.
  • Facilitated system interoperability by developing interfaces to allow data movement between different production systems via SAP Data Services.
  • Established best practice testing and data validation processes in conjunction with various internal departments to ensure data quality and predictable project success.
Technologies: SAP BusinessObjects Data Service (BODS), SAP R/3, Microsoft SQL Server, Oracle, PeopleSoft, Data Migration, SAP LSMW Data Migrations, ETL, Consulting, Relational Databases, SQL, ETL Development, Datasets, Databases, Business Intelligence (BI), Dashboards, Data Analysis, Data Engineering, SAP, Data Analytics, Data Cleansing, Data Cleaning, XML, Windows, Migration, Star Schema, ETL Tools, Data Visualization, CSV, Microsoft Excel, Data Integration, Entrepreneurship, ETL Implementation & Design, API Architecture, Reporting, Data Fetching

Senior Business Intelligence Consultant

2011 - 2012
Dawn Foods
  • Developed, maintained, and rolled out the migration of legacy data areas to new SAP environments using SAP Data Services and IDocs.
  • Implemented custom ETL processes using SAP LSMW processes.
  • Collaborated with various functional teams to help determine requirements and provide solutions for ETL processes.
Technologies: SAP BusinessObjects Data Service (BODS), SAP BusinessObjects (BO), SAP, Microsoft SQL Server, SAP LSMW Data Migrations, ETL, SAP R/3, Data Cleansing, Data Cleaning, XML, Consumer Packaged Goods (CPG), Windows, Databases, Migration, ETL Tools, Data Visualization, CSV, Microsoft Excel, Data Integration, Entrepreneurship, ETL Implementation & Design, API Architecture, Logistics, Reporting, Data Fetching

Senior Business Intelligence Consultant

2009 - 2011
Shaw
  • Oversaw, in conjunction with the IT management, a multi-phase 2-year project that successfully expanded data access by introducing new data sources, reports, and technologies to analysts and company leaders.
  • Streamlined data-driven decision making via working with the departmental stakeholders to finalize requirements and ultimately implement, test, and roll out reports in Crystal Reports, Web Intelligence, and Xcelsius.
  • Introduced best practice data quality and validation processes via implementing configuration management and development workflows within the various environments.
  • Assisted the internal staff with addressing PL/SQL stored procedure issues and mentored the team on implementing efficient SQL and stored procedures for reports and universes.
  • Enhanced the report developer and power user data analytic experiences through maintaining existing and developing new universes.
Technologies: SAP BusinessObjects (BO), Crystal Reports, PL/SQL, Microsoft SQL Server, Web Intelligence, Oracle, Java, ETL, Architecture, Consulting, Relational Databases, SQL, Datasets, Databases, Business Intelligence (BI), SQL Stored Procedures, Dashboards, Data Analysis, Data Modeling, Data Analytics, XML, Stored Procedure, Dimensional Modeling, Windows, Star Schema, Data Visualization, CSV, Microsoft Excel, Scripting Languages, Dashboard Design, Reporting, Data Fetching

Senior Business Intelligence Consultant

2010 - 2010
Expedia
  • Solved complex requirements for company-wide dashboards, scorecards, and visualizations using Xcelsius, Query as a Web Service, and universes.
  • Mentored staff on Crystal Report, Web Intelligence, and Xcelsius development issues and conducted training sessions on the full BO stack.
  • Diagnosed and resolved performance issues in large BusinessObjects Enterprise clustered environment, leading to more efficient user experiences for client-facing applications.
Technologies: SAP BO Dashboards, SAP BusinessObjects (BO), Web Intelligence, Crystal Reports, Architecture, Consulting, Relational Databases, SQL, Datasets, Databases, Business Intelligence (BI), SQL Stored Procedures, Dashboards, Data Analysis, Data Analytics, XML, JSON, Stored Procedure, Windows, Star Schema, Data Visualization, CSV, Microsoft Excel, Dashboard Design, Reporting, Data Fetching

Senior Business Intelligence Consultant

2008 - 2008
Fidelity Investments
  • Designed and implemented a Java web service that integrated SAP BusinessObjects and Crystal Reports to render pixel-perfect Investment Objective and Recommendation proposals and Investment Pool fact sheets for high net work clientele.
  • Created Crystal Reports, based on precise design specifications, to serve as the templates for customer-facing documents in the proposal delivery system.
  • Oversaw the migration of SAP BusinessObjects assets from a legacy version to a revamped architecture in version 3.1, which implemented fail-over, version control, and a more robust security model.
Technologies: SAP BusinessObjects (BO), Crystal Reports, Data Migration, Java, Web Services, XML, API Architecture, Scripting Languages, Dashboard Design, Reporting, Data Fetching

Kanary

https://kanary.cloud
Kanary is an internal fraud monitoring and protection software service that helps businesses mitigate losses from internal fraud.

As a co-founder, I architected and implemented the entire technology stack, including the analytics engine, application back-end, and UI/UX elements. It is primarily implemented in React, Node.js, and Express.

Mine to Mill Project

A data warehouse and analytics application for a Fortune 500 resources company. The successfully delivered application consumed thousands of data points from various sensors and the entire mining operation workflows at disparate mine sites, empowering users to perform ad hoc end-to-end performance analyses that had not previously been possible.

I was the BI architect and developer for ETL, data warehouse, reporting, testing, user validation, and deployment tasks.

Financial Performace Agent Portal and Data Warehouse

A C#.Net-based web portal for the biggest commercial real estate broker in North America that allowed thousands of sales agents across hundreds of districts to access metrics on performance, commissions, sales, and other financial analytics. I was responsible for architecting the data warehouse, developing custom and off the shelf ETL processes using T-SQL and SAP Data Services, developing Crystal Reports in SAP BusinessObjects for consumption through the web portal, developing the report bursting and distribution engine, and developing the web portal itself. The resulting application empowered agents and managers to access timely performance metrics in a self-serve fashion without having to rely on IT turnaround.

SAP HANA Medical Dashboard

Developed a next-generation interactive healthcare dashboard analytics set, based on SAP HANA models, for a leading Healthcare Analytics company. The resulting work was showcased with great success to potential clients at SAP's annual user conference, SAPPHIRE.

SAP BusinessObjects Unix Course Review and Audit

Based on my expertise in the SAP BusinessObjects Unix technology stack, I was brought in by SAP as a consultant to formally audit and review their Business Objects Enterprise XI: Administering Servers: Unix course material before it was deployed to the public for consumption.

Data Analytics for Mr. Carwash

Worked with a remote team on streamlining existing and developing a new set of Crystal Reports and Web Intelligence reports based on flat files and Microsoft SQL Server. The delivered reports enabled a consolidated view of how the company and the various car wash locations performed.

Vendor REST API to BigQuery Data Pipeline

A custom parallelized pipeline using Python, Google Cloud Storage, Hevo, and BigQuery. I designed, implemented, and oversaw the execution of the pipeline for ingesting and loading 200+ million records from a third-party vendor's throttled REST API.
1998 - 2003

Bachelor's Degree in Computer Science

University of British Columbia - Vancouver, BC, Canada

JANUARY 2023 - PRESENT

Microsoft Certified: Power BI Data Analyst Associate

Microsoft

JUNE 2020 - PRESENT

Salesforce Certified Tableau CRM and Einstein Discovery Consultant

Salesforce

APRIL 2010 - PRESENT

SAP Certified Application Associate for BusinessObjects Enterprise XI 3.x

SAP

FEBRUARY 2005 - PRESENT

BusinessObjects Enterprise XI Certified Professional

BusinessObjects

MAY 2004 - PRESENT

Crystal Enterprise 10 Certified Professional

BusinessObjects

Libraries/APIs

React, React Redux, Node.js, QuickBooks API, REST APIs, Stripe API, SendGrid API, Google Analytics API, Pandas, NumPy, Beautiful Soup, OpenAI Assistants API, Slack API, LinkedIn API, Facebook Ads API, GitHub API, Shopify API, Twitter API, Instagram API, Playwright, Reddit API

Tools

Crystal Reports, Looker, BigQuery, Microsoft Excel, Power Query, Salesforce Einstein, Adobe Photoshop, NGINX, Apache Airflow, Docker Compose, Google Analytics, Microsoft Power BI, Google Sheets, Postman, SAP UI5, Sequelize, GitHub, Radar, Lerna

Frameworks

Express.js, ASP.NET, Apache Spark, Spark, Selenium, Next.js, Fastify, Jest

Languages

JavaScript, HTML, CSS, Java, TypeScript, HTML5, SQL, XML, Stored Procedure, PHP, C#.NET, C++, Python, Solidity, C#, T-SQL (Transact-SQL), GraphQL

Paradigms

Object-oriented Programming (OOP), ETL, Business Intelligence (BI), Dimensional Modeling, Database Design, ETL Implementation & Design, API Architecture, Human Interface Design

Platforms

Oracle, Windows, Linux, SAP HANA, Ubuntu Linux, Red Hat Linux, Docker, Amazon Web Services (AWS), Google Cloud Platform (GCP), Xplenty, Azure, Vercel, Salesforce

Storage

PostgreSQL, Microsoft SQL Server, Database Migration, PL/SQL, Databases, Relational Databases, SQL Stored Procedures, JSON, Data Pipelines, MySQL, Data Integration, Database Architecture, SQL Server Integration Services (SSIS), Redis, IBM Db2, Google Cloud, SQL Server Reporting Services (SSRS)

Other

SAP BusinessObjects (BO), Web Intelligence, SAP BusinessObjects Data Service (BODS), ETL Development, Data Warehousing, Data Migration, SAP BO Dashboards, Software Development, Algorithms, Consulting, Architecture, Data Architecture, Data Warehouse Design, Datasets, Dashboards, Data Analysis, Data Engineering, Data Modeling, Data Analytics, API Connectors, Data Cleansing, Data Cleaning, Google BigQuery, Hevo Data, ELT, APIs, Migration, Star Schema, ETL Tools, Data Visualization, CSV, Full-stack, API Integration, Entrepreneurship, DAX, Scripting Languages, Dashboard Design, Reporting, Data Scraping, Data Fetching, Tableau CRM, SAP R/3, SAP LSMW Data Migrations, Ellipse, SAP, Azure Data Lake, Matillion, QuickBooks Online, Web Services, Logistics, PeopleSoft, Fivetran, Rivery, Cloud Data Fusion, Integrate.io, Consumer Packaged Goods (CPG), Investment Banking, Finance, Airtable, OpenAI, OpenAI GPT-3 API, OpenAI GPT-4 API, Pinecone, Apollo Server, Google Pub/Sub, Natural Language Queries, Reply.io API, HubSpot API, TikTok Ads, Segment.io API

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring