Josh is available for hire
Hire JoshJosh Chapman
Verified Expert in Engineering
Data Warehousing Developer
Los Angeles, CA, United States
Toptal member since October 14, 2019
Bio
Josh is an engineering leader and architect with a special passion for data. He's been building data warehouses and reporting platforms for top retailers and eCommerce startups for over a decade. He loves learning and meeting new teams, and he's well-versed in the latest trends and tools in data.
Portfolio
ChowNow
Data Build Tool (dbt), Snowflake, Fivetran, Matillion...
The Honest Company
Amazon Web Services (AWS), Dimensional Modeling, Data Warehouse Design...
Nordstrom
Amazon Web Services (AWS), Data Warehouse Design, Data Warehousing, SQL, Bash...
Experience
- ETL - 20 years
- SQL - 20 years
- Data Warehousing - 20 years
- Data Modeling - 16 years
- Business Intelligence (BI) - 14 years
- Redshift - 5 years
- Snowflake - 4 years
- Apache Airflow - 3 years
Preferred Environment
Git, Atom, JetBrains IDE, Linux, MacOS
The most amazing...
...projects are those that have the biggest impact, not the fanciest code. I've built data warehouses using cheap tools that saved hundreds of person-hours a week.
Work Experience
Director of Data Engineering
2021 - 2024
ChowNow
- Hired and managed the 1st analytics engineering team at the company.
- Built the data pipeline to power the data warehouse used for all company reporting, analytics, and machine learning, primarily using dbt, Fivetran, and Hightouch.
- Built all data structures to support a custom in-house app for the customer experience team, putting crucial analytics in their hands for customer conversations and greatly streamlining their daily workflow.
Technologies: Data Build Tool (dbt), Snowflake, Fivetran, Matillion, Visual Studio Code (VS Code), Python, Tableau, Mode Analytics, Amazon S3 (AWS S3), Amazon RDS, AWS IAM, AWS Database Migration Service (DMS), SQL, APIs, Google Sheets API, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Databases, Data Visualization, Database Design, DB, Database Architecture, Database Schema Design, Data Warehouse Testing, Agile, Data Modeling, Data Integration, Excel 365, Data Analysis
Senior Manager | Data Engineering
2019 - 2021
The Honest Company
- Built and scaled the company's data warehouse using Amazon Redshift.
- Integrated with new SaaS vendors including Salesforce Commerce Cloud.
- Implemented Airflow for job orchestration, using the Astronomer platform.
- Brought modern data SDLC practices to the data engineering team.
- Rebuilt users' trust in data by fixing reports, implementing clear support procedures, and migrating to a new BI tool.
Technologies: Amazon Web Services (AWS), Dimensional Modeling, Data Warehouse Design, Data Warehousing, Domo, Tableau, SQL, Bash, PostgreSQL, MySQL, Relational Database Services (RDS), Talend, Apache Airflow, Python, Redshift, Data Engineering, Dashboards, Reporting, Data Analytics, APIs, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Data Migration, Databases, Data Visualization, Database Design, DB, Database Architecture, Database Schema Design, Data Warehouse Testing, Agile, Data Modeling, Amazon EC2, Salesforce Marketing Cloud, eCommerce, Data Integration, Excel 365, Data Analysis
Engineering Manager, Data Services
2014 - 2019
Nordstrom
- Scaled up the data warehouse while improving performance and availability.
- Implemented a data lake on AWS using S3, Spectrum, and Spark.
- Scripted all infrastructure provisioning and configuration using Terraform and Ansible.
- Redesigned and rewrote the ETL loading our Amazon Redshift Data Warehouse.
- Built the Data Services team from zero to seven engineers, and served as interim manager for the Mobile Apps Engineering team.
Technologies: Amazon Web Services (AWS), Data Warehousing, Data Warehouse Design, SQL, Bash, MySQL, Terraform, Ansible, Python, Pentaho Data Integration (Kettle), Google BigQuery, Redshift, Data Engineering, Dashboards, Reporting, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Data Migration, Databases, Data Visualization, Database Design, DB, Database Architecture, Database Schema Design, Pentaho, Data Warehouse Testing, SQL Server 2012, Agile, Data Modeling, Amazon EC2, Salesforce Marketing Cloud, eCommerce, Data Integration, Excel 365, Data Analysis
Manager of Data Services
2011 - 2014
ideel
- Led the effort to design and build ideeli's enterprise data warehouse.
- Served as the team's architect and senior developer - designing, building, reviewing, deploying, and supporting ETL jobs, SQL scripts, and reports.
- Led combined onshore and offshore teams in the implementation of MicroStrategy for end-user reporting and analysis.
- Designed the company's ETL architecture from scratch, using Pentaho Data Integration (Kettle) and custom MySQL routines. Led development and production support.
- Designed a key data integration system between the ERP and Warehouse Management systems, using PDI and MySQL.
- Debugged reports in a wide range of technologies: MicroStrategy, Pentaho, MySQL, MS SQL Server, SSAS, MS Access, Excel, Epicor, NetSuite, Talend ETL, Hive, and shell scripts.
Technologies: SQL, Data Warehouse Design, Data Warehousing, Bash, NetSuite, Epicor, Talend, Microsoft SQL Server, MicroStrategy, Pentaho, MySQL, Data Engineering, Reporting, Data Analytics, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Data Migration, Databases, Data Visualization, Database Design, DB, Database Architecture, Database Schema Design, Data Warehouse Testing, Data Modeling, Amazon EC2, eCommerce, Data Integration, SQL Stored Procedures
Software Developer
2009 - 2011
Bridgewater Associates
- Designed and developed the data model, ETL process, and reports for the system used to monitor counterparty exposure. Ran status meetings with sponsors, and managed the project plan (SSIS, T-SQL, SSRS, and AgilePoint).
- Got up to speed on previously unfamiliar business concepts – for instance, developed the database portion of a major new risk-control monitoring tool within a month of joining.
- Played key role in reorg to separate production support from development: designed the training and certification plan for new support associates; improved the procedures for incident handling and escalation; served as lead trainer.
Technologies: SQL, Data Warehousing, Data Warehouse Design, Stored Procedure, SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Microsoft SQL Server, Data Engineering, Reporting, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Transact-SQL (T-SQL), Databases, Data Visualization, Database Design, DB, Database Architecture, Database Schema Design, Data Warehouse Testing, SQL Server 2012, Data Modeling, Data Integration, SQL Stored Procedures
Senior Consultant
2005 - 2008
Palladium Group
- Designed and led the development of a budget analysis application for a leading office supply retailer (MS SQL Server, Hyperion Essbase, Windows Batch Scripting).
- Led redesign of the sales-reporting app for a leading yellow-pages publisher. (Informatica and Oracle).
- Designed and developed database components of a sales reporting and forecasting tool for a major quick-service restaurant company (PL/SQL, Bash, Hyperion Planning, and Hyperion Reports).
Technologies: SQL, Data Warehouse Design, Data Warehousing, Batch Scripting, Bash, Reports, Essbase, Hyperion, PL/SQL, Oracle Database, DB, Oracle, Microsoft SQL Server, Informatica, Data Engineering, Reporting, ETL, ETL Development, ETL Implementation & Design, ETL Testing, Transact-SQL (T-SQL), Databases, Database Design, Database Architecture, Database Schema Design, Data Modeling, Data Integration, SQL Stored Procedures
Consultant
2003 - 2005
CGI
- Served as a data warehouse developer on a long-term engagement for a large telecom.
- Reviewed requirements and data models, wrote designs, wrote and tested code, and supported production.
- Served as tech lead for the major redesign of an existing marketing data warehouse (Informatica PowerCenter, Oracle PL/SQL, Bash).
Technologies: SQL, Data Warehousing, Data Warehouse Design, Bash, PL/SQL, Oracle Database, Informatica, Data Engineering, ETL, ETL Development, ETL Implementation & Design, ETL Testing, Databases, Database Design, DB, Database Architecture, Database Schema Design, Data Modeling, Data Integration, SQL Stored Procedures
Experience
Flask App for Interactive Commands in Slack
https://github.com/joshuahchapman/birders-slackbotA simple Flask app that runs on Heroku with a PostgreSQL database that I developed as a hobby project. It handles interactive commands for a Slack workspace that I created and maintain. It uses citizen science data from the eBird (ebird.org) API.
Reporting Data Pipeline Using Data Build Tool, Redshift, and Periscope
Redesigned the reporting environment for an insurance startup. They were struggling with performance issues in their reports due to the use of nested, overly complex views in Periscope and resource contention in Redshift. I chose and implemented the Data Build Tool (dbt) to create tables in the database and used Python to automate the migration of reports to use the new tables.
Migration from Redshift to Snowflake
A financial services company with very large data volumes wanted to migrate its data warehouse from Redshift to Snowflake while continuing to support many Tableau dashboards that used it. I recreated the key database objects in Snowflake and updated the dashboards to use them.
Analytics Solution for Healthcare Consultancy
Built and maintained a data pipeline and visualization layer for data related to health insurance claims. Processed files using Python running in AWS Lambda, landed in Snowflake, used dbt to cleanse and transform data, and built analyses and visualizations in Hex Analytics.
Education
1998 - 2002
Bachelor's Degree in Computer Science (Minor in German Studies)
Amherst College - Amherst, MA, USA
Skills
Libraries/APIs
Google Sheets API, Slack API
Tools
Pentaho Data Integration (Kettle), Tableau, Domo, Salesforce Marketing Cloud, Google Sheets, Atom, Git, Apache Airflow, Ansible, Terraform, Hyperion, Talend ETL, Amazon Elastic Block Store (EBS), Stitch Data, Periscope Data, Matillion ETL for Redshift, AWS IAM
Languages
SQL, Snowflake, Transact-SQL (T-SQL), Bash, Stored Procedure, Python
Paradigms
ETL, Business Intelligence (BI), ETL Implementation & Design, Database Design, Agile, Dimensional Modeling, HIPAA Compliance
Storage
Database Architecture, Microsoft SQL Server, DB, Redshift, MySQL, PostgreSQL, SQL Server 2012, Data Lakes, Data Integration, Amazon S3 (AWS S3), Databases, SQL Stored Procedures, SQL Server Reporting Services (SSRS), PL/SQL, Essbase, SQL Server Integration Services (SSIS), Salesforce Commerce Cloud
Platforms
Pentaho, Amazon EC2, MacOS, Linux, Talend, Oracle, Oracle Database, Amazon Web Services (AWS), Google Analytics 360, Visual Studio Code (VS Code), Heroku, Hex, AWS Lambda
Other
Data Warehouse Design, Data Warehousing, Data Modeling, Software Development, Data Engineering, Reporting, ETL Development, Database Schema Design, Data Build Tool (dbt), Google BigQuery, MicroStrategy, eCommerce, SSRS Reports, Fivetran, Dashboards, Data Analytics, APIs, ETL Testing, Data Migration, Data Visualization, Data Warehouse Testing, Excel 365, Data Analysis, JetBrains IDE, Relational Database Services (RDS), Epicor, NetSuite, Reports, Batch Scripting, Informatica, Analytics, Amazon Kinesis, Matillion, Mode Analytics, Amazon RDS, AWS Database Migration Service (DMS), Heroku Postgres, Heroku Add-ons, Computer Science, Algorithms, HIPAA Electronic Data Interchange (EDI)
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring