Allan is available for hire
Hire AllanAllan Carruthers
Verified Expert in Engineering
Business Intelligence Developer
Location
Vancouver, BC, Canada
Toptal Member Since
February 22, 2022
Allan is a seasoned data engineer and developer with 17 years of experience building elegant and creative products and services that make customers happy. He has delivered over 100 successful projects for his body of Fortune 1000 clientele. A specialist in business intelligence, systems integration, and application development, Allan continually solves complex problems as an entrepreneur, architect, designer, and implementer.
Portfolio
Salient Business Intelligence
SAP BusinessObjects (BO), SAP BusinessObjects Data Service (BODS)...
Livedocs
Node.js, Python, TypeScript, Fivetran, PostgreSQL, Google BigQuery...
Kanary
Node.js, React, React Redux, Express.js, TypeScript, PostgreSQL, Redis, HTML5...
Experience
Availability
Full-time
Preferred Environment
Windows, Linux
The most amazing...
...thing I've developed is Kanary, an employee fraud-mitigation product for small businesses, where I've designed and implemented the entire technology stack.
Work Experience
Senior Business Intelligence Consultant
2007 - PRESENT
Salient Business Intelligence
- Aided 100+ clients to design and implement robust data pipelines to fulfill downstream business intelligence and operational needs, using SAP Data Services, Microsoft SSIS, and custom development.
- Led and assisted enterprise clients in delivering and integrating end-to-end technology solutions using the SAP BusinessObjects suite of products, coupled with IT architectures that spanned most technology stacks and industry verticals.
- Learned quickly and became effective in any product or technology that enabled delivering solutions and client success.
- Re-engaged by clients to assist with multi-year projects based on the history of delivering high-quality, successful work.
Technologies: SAP BusinessObjects (BO), SAP BusinessObjects Data Service (BODS), Web Intelligence, Crystal Reports, C#.NET, Java, Oracle, IBM Db2, Microsoft SQL Server, Data Migration, JavaScript, HTML, CSS, SAP LSMW Data Migrations, HTML5, ETL, Data Architecture, Architecture, Consulting, Relational Databases, SQL, SQL Server Integration Services (SSIS), PHP, ETL Development, SAP HANA, Data Warehouse Design, Datasets, Databases, Python, Business Intelligence (BI), SQL Stored Procedures, Dashboards, Data Warehousing, Data Analysis, Data Engineering, Data Modeling, SAP, Data Analytics, API Connectors, Data Cleansing, Data Cleaning, XML, JSON, C#, APIs, Stored Procedure, T-SQL (Transact-SQL), Google Analytics, Consumer Packaged Goods (CPG), Dimensional Modeling, Microsoft Power BI, REST APIs, Windows, Linux, Ubuntu Linux, Azure, Migration, Star Schema, ETL Tools, Google Sheets, Data Visualization, CSV, Microsoft Excel, Full-stack, MySQL, Data Pipelines, QuickBooks Online, Data Integration, Postman, API Integration, Entrepreneurship, Investment Banking, Finance, Web Services, Database Architecture, Database Design, ETL Implementation & Design, API Architecture, Logistics, DAX, Power Query, Scripting Languages, Looker, Dashboard Design, BigQuery, SQL Server Reporting Services (SSRS), Reporting, Data Fetching, Data Scraping, Airtable
Data Engineer | Data Integration Specialist | Node.js Back-end Developer
2023 - 2024
Livedocs
- Architected and implemented the core data integration layer, enabling Livedocs users to sync metrics and data from popular cloud applications like Facebook Ads, Shopify, and Segment to internal data repositories for consumption by the Livedocs application.
- Developed and implemented a metrics service that aggregated relevant user metrics based on connected integrations. Continuously compiled metrics were utilized by front-end reporting, dashboards, and alerts.
- Created a data service enabling users to configure report specifications via the front end. Generated optimized SQL queries to retrieve the necessary data and packaged it into a format suitable for front-end visualizations.
- Developed a natural language querying service that used GPT-4, Pinecone, and local metadata to translate user data questions via Slack and within the Livedocs application into SQL queries that returned data that answered the questions.
Technologies: Node.js, Python, TypeScript, Fivetran, PostgreSQL, Google BigQuery, Google Cloud Platform (GCP), Vercel, Next.js, Redis, OpenAI, OpenAI GPT-3 API, OpenAI GPT-4 API, OpenAI Assistants API, Pinecone, SQL, Slack API, Express.js, GraphQL, Apollo Server, Sequelize, Fastify, Google Pub/Sub, Natural Language Queries, LinkedIn API, Reply.io API, Facebook Ads API, Google Analytics API, GitHub API, HubSpot API, TikTok Ads, Shopify API, Twitter API, SendGrid API, Instagram API, Segment.io API, GitHub, Jest, Playwright, Radar, Stripe API, Reddit API, Lerna
Co-founder | CTO
2020 - 2024
Kanary
- Designed and implemented the back end and analytics engine with various technologies, including Node.js, Express, and PostgreSQL.
- Built and implemented automated, parallelized data pipelines in Node.js using BullMQ, Redis, and PostgreSQL. The resulting system ingested QuickBooks Online data and transformed it into an agnostic format for analysis by the analytics engine.
- Created and implemented intuitive and effective UI/UX using Node.js, React, Redux, TypeScript, HTML5, and CSS.
- Developed integrations with 3rd-party vendors such as Stripe, QuickBooks Online, SendGrid, and Google Analytics.
- Collaborated with the beta customers to refine UI/UX using Figma and rapid prototyping.
- Developed and executed marketing and sales strategies to facilitate growth.
Technologies: Node.js, React, React Redux, Express.js, TypeScript, PostgreSQL, Redis, HTML5, CSS, NGINX, Ubuntu Linux, Stripe API, QuickBooks API, SendGrid API, Google Analytics API, HTML, Data Architecture, Architecture, Relational Databases, SQL, Adobe Photoshop, ETL Development, Datasets, Databases, Business Intelligence (BI), Dashboards, Data Warehousing, ETL, Data Warehouse Design, Data Analysis, Data Engineering, Data Modeling, Data Analytics, API Connectors, JSON, APIs, Google Analytics, Dimensional Modeling, REST APIs, Windows, Linux, Migration, Star Schema, ETL Tools, Data Visualization, CSV, Microsoft Excel, Full-stack, Data Pipelines, QuickBooks Online, Data Integration, Postman, API Integration, Entrepreneurship, Database Architecture, Database Design, ETL Implementation & Design, API Architecture, Scripting Languages, Dashboard Design, Reporting, Data Fetching, Data Scraping
Senior Data Engineer | Data Warehouse Architect
2022 - 2022
Insurance Proz Solutions, LLC
- Architected and implemented the extraction, load, and transformation of disparate data into a powerful, consolidated data store representing the single source of truth for company metrics.
- Implemented robust, autonomous data pipelines using Python and third-party tools that continuously extracted and loaded large volumes of data from REST APIs, MySQL, and flat files into BigQuery for further analysis.
- Designed and implemented on-demand dashboards in Looker that enabled the client to have a consolidated view of operational and financial performance. KPI turnaround time was reduced from half a day to seconds.
- Oversaw the discovery and evaluation of third-party ELT, ETL, reporting, and data warehousing technology stacks, allowing the client to achieve a solution with a winning balance of product functionality, cost, and scalability.
Technologies: Data Engineering, Data Warehouse Design, Data Warehousing, Google BigQuery, Data Modeling, Business Intelligence (BI), Hevo Data, ELT, ETL, Python, MySQL, REST APIs, Google Cloud Platform (GCP), Fivetran, Rivery, Cloud Data Fusion, Xplenty, Integrate.io, APIs, BigQuery, Looker, Dimensional Modeling, Azure Data Lake, Azure, JSON, API Connectors, Google Cloud, Windows, ETL Development, Data Migration, Databases, SQL, Relational Databases, Migration, Matillion, Star Schema, ETL Tools, Google Sheets, Data Visualization, CSV, Microsoft Excel, Data Pipelines, Data Integration, Postman, API Integration, Database Architecture, Database Design, ETL Implementation & Design, API Architecture, DAX, Power Query, Scripting Languages, Dashboard Design, Reporting, Data Fetching, Airtable
Data Engineer
2022 - 2022
medONE Corporation
- Worked in a distributed team to develop an electronic document interface (EDI) billing document analysis pipeline and engine in Python that aimed to catch errors, reduce insurance provider rejections, and improve cash flow for medical practices.
- Interfaced with and developed unit tests for a minimally documented 3rd-party EDI billing analysis API, a key component of the in-house solution.
- Debugged and troubleshot existing problematic code to assist data scientist productivity.
Technologies: ETL, SQL, Data Pipelines, Data Engineering, Python, Spark, Selenium, Pandas, NumPy, Beautiful Soup, Amazon Web Services (AWS), APIs, REST APIs, JSON, API Connectors, Linux, ETL Development, Databases, CSV, Data Integration, Postman, API Integration, API Architecture, Scripting Languages, Reporting, Data Fetching, Data Scraping
Senior Business Intelligence Consultant
2016 - 2021
Cleveland-Cliffs
- Oversaw BI aspects of the company-wide ERP upgrade, focusing on the ETL process, upgrade, testing, and rollout.
- Reduced the turnaround time for management and departmental users by delivering accurate, timely information via Web Intelligence (WEBI) reports and underlying data processes.
- Managed the implementation of the ETL process conversion to implement best practice methodologies around reliability and performance.
- Expanded data access and quality by maintaining existing Oracle data warehouse initiatives and architecting new ones.
- Improved the data quality and reliability through implementing best practice configuration management, testing, and validation for ETL processes across various environments.
- Worked with various internal companies and departments to successfully architect and implement custom analytic applications that improved data access and reduced IT dependency.
- Worked with disparate internal companies to design and implement unique data pipelines that fed into central data stores to give senior management a reliable, consolidated view of company operations.
Technologies: SAP BusinessObjects (BO), SAP BusinessObjects Data Service (BODS), Web Intelligence, Oracle, Microsoft SQL Server, Data Warehousing, Database Migration, Data Migration, HTML, ETL, Data Architecture, Architecture, Consulting, Relational Databases, SQL, SQL Server Integration Services (SSIS), ETL Development, Data Warehouse Design, Datasets, Databases, Business Intelligence (BI), SQL Stored Procedures, Dashboards, Data Analysis, Data Engineering, Data Modeling, Data Analytics, Data Cleansing, Data Cleaning, JSON, Stored Procedure, T-SQL (Transact-SQL), Dimensional Modeling, Microsoft Power BI, Windows, Migration, Star Schema, ETL Tools, Data Visualization, CSV, Microsoft Excel, Data Pipelines, Data Integration, Entrepreneurship, Finance, Database Architecture, Database Design, ETL Implementation & Design, API Architecture, Logistics, DAX, Power Query, Scripting Languages, Dashboard Design, Reporting, Data Fetching, Data Scraping
Senior Business Intelligence Consultant
2015 - 2021
Marcus & Millichap
- Expanded the company data access and quality by maintaining the existing and developing new ETL functionality using SQL Server, SAP Data Services, and SAP R/3.
- Streamlined the existing and developed new, highly-visible, and actionable financial reports for senior management.
- Empowered the senior financial staff to have timely access to the secure, personalized, regional performance data via a custom-developed report generation and distribution application.
- Reduced the user dependence on IT analysts by designing and developing a self-serve, custom portal in C# .NET for sales agents to access performance and commission metrics.
Technologies: C#.NET, SAP BusinessObjects (BO), Crystal Reports, SAP BusinessObjects Data Service (BODS), Microsoft SQL Server, ASP.NET, SAP R/3, Data Migration, HTML, JavaScript, CSS, HTML5, ETL, Data Architecture, Architecture, Consulting, Relational Databases, SQL, SQL Server Integration Services (SSIS), ETL Development, Data Warehouse Design, Datasets, Databases, Business Intelligence (BI), SQL Stored Procedures, Dashboards, Data Warehousing, Data Analysis, Data Engineering, Data Modeling, SAP, Data Analytics, API Connectors, Data Cleansing, Data Cleaning, XML, JSON, C#, APIs, Stored Procedure, T-SQL (Transact-SQL), Dimensional Modeling, Windows, Migration, Star Schema, ETL Tools, Data Visualization, CSV, Microsoft Excel, Full-stack, Data Pipelines, Data Integration, API Integration, Entrepreneurship, Microsoft Power BI, Finance, Database Architecture, Database Design, ETL Implementation & Design, API Architecture, DAX, Power Query, Scripting Languages, Dashboard Design, SQL Server Reporting Services (SSRS), Reporting, Data Fetching, Data Scraping
Senior Business Intelligence Consultant
2014 - 2015
Veolia
- Migrated master data elements from disparate legacy systems to SAP in collaboration with various internal companies.
- Facilitated system interoperability by developing interfaces to allow data movement between different production systems via SAP Data Services.
- Established best practice testing and data validation processes in conjunction with various internal departments to ensure data quality and predictable project success.
Technologies: SAP BusinessObjects Data Service (BODS), SAP R/3, Microsoft SQL Server, Oracle, PeopleSoft, Data Migration, SAP LSMW Data Migrations, ETL, Consulting, Relational Databases, SQL, ETL Development, Datasets, Databases, Business Intelligence (BI), Dashboards, Data Analysis, Data Engineering, SAP, Data Analytics, Data Cleansing, Data Cleaning, XML, Windows, Migration, Star Schema, ETL Tools, Data Visualization, CSV, Microsoft Excel, Data Integration, Entrepreneurship, ETL Implementation & Design, API Architecture, Reporting, Data Fetching
Senior Business Intelligence Consultant
2011 - 2012
Dawn Foods
- Developed, maintained, and rolled out the migration of legacy data areas to new SAP environments using SAP Data Services and IDocs.
- Implemented custom ETL processes using SAP LSMW processes.
- Collaborated with various functional teams to help determine requirements and provide solutions for ETL processes.
Technologies: SAP BusinessObjects Data Service (BODS), SAP BusinessObjects (BO), SAP, Microsoft SQL Server, SAP LSMW Data Migrations, ETL, SAP R/3, Data Cleansing, Data Cleaning, XML, Consumer Packaged Goods (CPG), Windows, Databases, Migration, ETL Tools, Data Visualization, CSV, Microsoft Excel, Data Integration, Entrepreneurship, ETL Implementation & Design, API Architecture, Logistics, Reporting, Data Fetching
Senior Business Intelligence Consultant
2009 - 2011
Shaw
- Oversaw, in conjunction with the IT management, a multi-phase 2-year project that successfully expanded data access by introducing new data sources, reports, and technologies to analysts and company leaders.
- Streamlined data-driven decision making via working with the departmental stakeholders to finalize requirements and ultimately implement, test, and roll out reports in Crystal Reports, Web Intelligence, and Xcelsius.
- Introduced best practice data quality and validation processes via implementing configuration management and development workflows within the various environments.
- Assisted the internal staff with addressing PL/SQL stored procedure issues and mentored the team on implementing efficient SQL and stored procedures for reports and universes.
- Enhanced the report developer and power user data analytic experiences through maintaining existing and developing new universes.
Technologies: SAP BusinessObjects (BO), Crystal Reports, PL/SQL, Microsoft SQL Server, Web Intelligence, Oracle, Java, ETL, Architecture, Consulting, Relational Databases, SQL, Datasets, Databases, Business Intelligence (BI), SQL Stored Procedures, Dashboards, Data Analysis, Data Modeling, Data Analytics, XML, Stored Procedure, Dimensional Modeling, Windows, Star Schema, Data Visualization, CSV, Microsoft Excel, Scripting Languages, Dashboard Design, Reporting, Data Fetching
Senior Business Intelligence Consultant
2010 - 2010
Expedia
- Solved complex requirements for company-wide dashboards, scorecards, and visualizations using Xcelsius, Query as a Web Service, and universes.
- Mentored staff on Crystal Report, Web Intelligence, and Xcelsius development issues and conducted training sessions on the full BO stack.
- Diagnosed and resolved performance issues in large BusinessObjects Enterprise clustered environment, leading to more efficient user experiences for client-facing applications.
Technologies: SAP BO Dashboards, SAP BusinessObjects (BO), Web Intelligence, Crystal Reports, Architecture, Consulting, Relational Databases, SQL, Datasets, Databases, Business Intelligence (BI), SQL Stored Procedures, Dashboards, Data Analysis, Data Analytics, XML, JSON, Stored Procedure, Windows, Star Schema, Data Visualization, CSV, Microsoft Excel, Dashboard Design, Reporting, Data Fetching
Senior Business Intelligence Consultant
2008 - 2008
Fidelity Investments
- Designed and implemented a Java web service that integrated SAP BusinessObjects and Crystal Reports to render pixel-perfect Investment Objective and Recommendation proposals and Investment Pool fact sheets for high net work clientele.
- Created Crystal Reports, based on precise design specifications, to serve as the templates for customer-facing documents in the proposal delivery system.
- Oversaw the migration of SAP BusinessObjects assets from a legacy version to a revamped architecture in version 3.1, which implemented fail-over, version control, and a more robust security model.
Technologies: SAP BusinessObjects (BO), Crystal Reports, Data Migration, Java, Web Services, XML, API Architecture, Scripting Languages, Dashboard Design, Reporting, Data Fetching
Experience
Kanary
https://kanary.cloudKanary is an internal fraud monitoring and protection software service that helps businesses mitigate losses from internal fraud.
As a co-founder, I architected and implemented the entire technology stack, including the analytics engine, application back-end, and UI/UX elements. It is primarily implemented in React, Node.js, and Express.
As a co-founder, I architected and implemented the entire technology stack, including the analytics engine, application back-end, and UI/UX elements. It is primarily implemented in React, Node.js, and Express.
Mine to Mill Project
A data warehouse and analytics application for a Fortune 500 resources company. The successfully delivered application consumed thousands of data points from various sensors and the entire mining operation workflows at disparate mine sites, empowering users to perform ad hoc end-to-end performance analyses that had not previously been possible.
I was the BI architect and developer for ETL, data warehouse, reporting, testing, user validation, and deployment tasks.
I was the BI architect and developer for ETL, data warehouse, reporting, testing, user validation, and deployment tasks.
Financial Performace Agent Portal and Data Warehouse
A C#.Net-based web portal for the biggest commercial real estate broker in North America that allowed thousands of sales agents across hundreds of districts to access metrics on performance, commissions, sales, and other financial analytics. I was responsible for architecting the data warehouse, developing custom and off the shelf ETL processes using T-SQL and SAP Data Services, developing Crystal Reports in SAP BusinessObjects for consumption through the web portal, developing the report bursting and distribution engine, and developing the web portal itself. The resulting application empowered agents and managers to access timely performance metrics in a self-serve fashion without having to rely on IT turnaround.
SAP HANA Medical Dashboard
Developed a next-generation interactive healthcare dashboard analytics set, based on SAP HANA models, for a leading Healthcare Analytics company. The resulting work was showcased with great success to potential clients at SAP's annual user conference, SAPPHIRE.
SAP BusinessObjects Unix Course Review and Audit
Based on my expertise in the SAP BusinessObjects Unix technology stack, I was brought in by SAP as a consultant to formally audit and review their Business Objects Enterprise XI: Administering Servers: Unix course material before it was deployed to the public for consumption.
Data Analytics for Mr. Carwash
Worked with a remote team on streamlining existing and developing a new set of Crystal Reports and Web Intelligence reports based on flat files and Microsoft SQL Server. The delivered reports enabled a consolidated view of how the company and the various car wash locations performed.
Vendor REST API to BigQuery Data Pipeline
A custom parallelized pipeline using Python, Google Cloud Storage, Hevo, and BigQuery. I designed, implemented, and oversaw the execution of the pipeline for ingesting and loading 200+ million records from a third-party vendor's throttled REST API.
Skills
Languages
JavaScript, HTML, CSS, Java, TypeScript, HTML5, SQL, XML, Stored Procedure, PHP, C#.NET, C++, Python, Solidity, C#, T-SQL (Transact-SQL), GraphQL
Frameworks
Express.js, ASP.NET, Apache Spark, Spark, Selenium, Next.js, Fastify, Jest
Libraries/APIs
React, React Redux, Node.js, QuickBooks API, REST APIs, Stripe API, SendGrid API, Google Analytics API, Pandas, NumPy, Beautiful Soup, OpenAI Assistants API, Slack API, LinkedIn API, Facebook Ads API, GitHub API, Shopify API, Twitter API, Instagram API, Playwright, Reddit API
Tools
Crystal Reports, Looker, BigQuery, Microsoft Excel, Power Query, Salesforce Einstein, Adobe Photoshop, NGINX, Apache Airflow, Docker Compose, Google Analytics, Microsoft Power BI, Google Sheets, Postman, SAP UI5, Sequelize, GitHub, Radar, Lerna
Paradigms
Object-oriented Programming (OOP), ETL, Business Intelligence (BI), Dimensional Modeling, Database Design, ETL Implementation & Design, API Architecture, Human Interface Design
Platforms
Oracle, Windows, Linux, SAP HANA, Ubuntu Linux, Red Hat Linux, Docker, Amazon Web Services (AWS), Google Cloud Platform (GCP), Xplenty, Azure, Vercel
Storage
PostgreSQL, Microsoft SQL Server, Database Migration, PL/SQL, Databases, Relational Databases, SQL Stored Procedures, JSON, Data Pipelines, MySQL, Data Integration, Database Architecture, SQL Server Integration Services (SSIS), Redis, IBM Db2, Google Cloud, SQL Server Reporting Services (SSRS)
Other
SAP BusinessObjects (BO), Web Intelligence, SAP BusinessObjects Data Service (BODS), ETL Development, Data Warehousing, Data Migration, SAP BO Dashboards, Software Development, Algorithms, Consulting, Architecture, Data Architecture, Data Warehouse Design, Datasets, Dashboards, Data Analysis, Data Engineering, Data Modeling, Data Analytics, API Connectors, Data Cleansing, Data Cleaning, Google BigQuery, Hevo Data, ELT, APIs, Migration, Star Schema, ETL Tools, Data Visualization, CSV, Full-stack, API Integration, Entrepreneurship, DAX, Scripting Languages, Dashboard Design, Reporting, Data Scraping, Data Fetching, Tableau CRM, SAP R/3, SAP LSMW Data Migrations, Ellipse, SAP, Azure Data Lake, Matillion, QuickBooks Online, Web Services, Logistics, PeopleSoft, Fivetran, Rivery, Cloud Data Fusion, Integrate.io, Consumer Packaged Goods (CPG), Investment Banking, Finance, Airtable, OpenAI, OpenAI GPT-3 API, OpenAI GPT-4 API, Pinecone, Apollo Server, Google Pub/Sub, Natural Language Queries, Reply.io API, HubSpot API, TikTok Ads, Segment.io API
Education
1998 - 2003
Bachelor's Degree in Computer Science
University of British Columbia - Vancouver, BC, Canada
Certifications
JANUARY 2023 - PRESENT
Microsoft Certified: Power BI Data Analyst Associate
Microsoft
JUNE 2020 - PRESENT
Salesforce Certified Tableau CRM and Einstein Discovery Consultant
Salesforce
APRIL 2010 - PRESENT
SAP Certified Application Associate for BusinessObjects Enterprise XI 3.x
SAP
FEBRUARY 2005 - PRESENT
BusinessObjects Enterprise XI Certified Professional
BusinessObjects
MAY 2004 - PRESENT
Crystal Enterprise 10 Certified Professional
BusinessObjects
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring