Josh Chapman, Developer in Los Angeles, CA, United States
Josh is available for hire
Hire Josh

Josh Chapman

Verified Expert  in Engineering

Bio

Josh is an engineering leader and architect with a special passion for data. He's been building data warehouses and reporting platforms for top retailers and eCommerce startups for over a decade. He loves learning and meeting new teams, and he's well-versed in the latest trends and tools in data.

Portfolio

ChowNow
Data Build Tool (dbt), Snowflake, Fivetran, Matillion...
The Honest Company
Amazon Web Services (AWS), Dimensional Modeling, Data Warehouse Design...
Nordstrom
Amazon Web Services (AWS), Data Warehouse Design, Data Warehousing, SQL, Bash...

Experience

  • ETL - 20 years
  • SQL - 20 years
  • Data Warehousing - 20 years
  • Data Modeling - 16 years
  • Business Intelligence (BI) - 14 years
  • Redshift - 5 years
  • Snowflake - 4 years
  • Apache Airflow - 3 years

Availability

Part-time

Preferred Environment

Git, Atom, JetBrains, Linux, MacOS

The most amazing...

...projects are those that have the biggest impact, not the fanciest code. I've built data warehouses using cheap tools that saved hundreds of person-hours a week.

Work Experience

Director of Data Engineering

2021 - PRESENT
ChowNow
  • Hired and managed the first analytics engineering team at the company.
  • Built the data pipeline to power the data warehouse used for all company reporting, analytics, and machine learning, primarily using dbt, Fivetran, and Hightouch.
  • Built all data structures to support a custom in-house app for the customer experience team, putting crucial analytics in their hands for customer conversations and greatly streamlining their daily workflow.
Technologies: Data Build Tool (dbt), Snowflake, Fivetran, Matillion, Visual Studio Code (VS Code), Python, Tableau, Mode Analytics, Amazon S3 (AWS S3), Amazon RDS, AWS IAM, AWS Database Migration Service (DMS), SQL, APIs, Google Sheets API, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Databases, Data Visualization, Database Design, DB, Database Architecture, Database Schema Design

Senior Manager | Data Engineering

2019 - 2021
The Honest Company
  • Built and scaled the company's data warehouse using Amazon Redshift.
  • Integrated with new SaaS vendors including Salesforce Commerce Cloud.
  • Implemented Airflow for job orchestration, using the Astronomer platform.
  • Brought modern data SDLC practices to the data engineering team.
  • Rebuilt users' trust in data by fixing reports, implementing clear support procedures, and migrating to a new BI tool.
Technologies: Amazon Web Services (AWS), Dimensional Modeling, Data Warehouse Design, Data Warehousing, Domo, Tableau, SQL, Bash, PostgreSQL, MySQL, Relational Database Services (RDS), Talend, Apache Airflow, Python, Redshift, Data Engineering, Dashboards, Reporting, Data Analytics, APIs, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Data Migration, Databases, Data Visualization, Database Design, DB, Database Architecture, Database Schema Design

Engineering Manager, Data Services

2014 - 2019
Nordstrom
  • Scaled up the data warehouse while improving performance and availability.
  • Implemented a data lake on AWS using S3, Spectrum, and Spark.
  • Scripted all infrastructure provisioning and configuration using Terraform and Ansible.
  • Redesigned and rewrote the ETL loading our Amazon Redshift Data Warehouse.
  • Built the Data Services team from zero to seven engineers, and served as interim manager for the Mobile Apps Engineering team.
Technologies: Amazon Web Services (AWS), Data Warehousing, Data Warehouse Design, SQL, Bash, MySQL, Terraform, Ansible, Python, Pentaho Data Integration (Kettle), Google BigQuery, Redshift, Data Engineering, Dashboards, Reporting, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Data Migration, Databases, Data Visualization, Database Design, DB, Database Architecture, Database Schema Design, Pentaho

Manager of Data Services

2011 - 2014
ideel
  • Led the effort to design and build ideeli's enterprise data warehouse.
  • Served as the team's architect and senior developer - designing, building, reviewing, deploying, and supporting ETL jobs, SQL scripts, and reports.
  • Led combined onshore and offshore teams in the implementation of MicroStrategy for end-user reporting and analysis.
  • Designed the company's ETL architecture from scratch, using Pentaho Data Integration (Kettle) and custom MySQL routines. Led development and production support.
  • Designed a key data integration system between the ERP and Warehouse Management systems, using PDI and MySQL.
  • Debugged reports in a wide range of technologies: MicroStrategy, Pentaho, MySQL, MS SQL Server, SSAS, MS Access, Excel, Epicor, NetSuite, Talend ETL, Hive, and shell scripts.
Technologies: SQL, Data Warehousing, Data Warehouse Design, Bash, NetSuite, Epicor, Talend, Microsoft SQL Server, MicroStrategy, Pentaho, MySQL, Data Engineering, Reporting, Data Analytics, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Data Migration, Databases, Data Visualization, Database Design, DB, Database Architecture, Database Schema Design

Software Developer

2009 - 2011
Bridgewater Associates
  • Designed and developed the data model, ETL process, and reports for the system used to monitor counterparty exposure. Ran status meetings with sponsors, and managed the project plan (SSIS, T-SQL, SSRS, and AgilePoint).
  • Got up to speed on previously unfamiliar business concepts – for instance, developed the database portion of a major new risk-control monitoring tool within a month of joining.
  • Played key role in reorg to separate production support from development: designed the training and certification plan for new support associates; improved the procedures for incident handling and escalation; served as lead trainer.
Technologies: SQL, Data Warehousing, Data Warehouse Design, Stored Procedure, SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Microsoft SQL Server, Data Engineering, Reporting, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, T-SQL (Transact-SQL), Databases, Data Visualization, Database Design, DB, Database Architecture, Database Schema Design

Senior Consultant

2005 - 2008
Palladium Group
  • Designed and led the development of a budget analysis application for a leading office supply retailer (MS SQL Server, Hyperion Essbase, Windows Batch Scripting).
  • Led redesign of the sales-reporting app for a leading yellow-pages publisher. (Informatica and Oracle).
  • Designed and developed database components of a sales reporting and forecasting tool for a major quick-service restaurant company (PL/SQL, Bash, Hyperion Planning, and Hyperion Reports).
Technologies: SQL, Data Warehousing, Data Warehouse Design, Batch Scripting, Bash, Reports, Essbase, Hyperion, PL/SQL, Oracle Database, DB, Oracle, Microsoft SQL Server, Informatica, Data Engineering, Reporting, ETL, ETL Development, ETL Implementation & Design, ETL Testing, T-SQL (Transact-SQL), Databases, Database Design, Database Architecture, Database Schema Design

Consultant

2003 - 2005
CGI
  • Served as a data warehouse developer on a long-term engagement for a large telecom.
  • Reviewed requirements and data models, wrote designs, wrote and tested code, and supported production.
  • Served as tech lead for the major redesign of an existing marketing data warehouse (Informatica PowerCenter, Oracle PL/SQL, Bash).
Technologies: SQL, Data Warehousing, Data Warehouse Design, Bash, PL/SQL, Oracle Database, Informatica, Data Engineering, ETL, ETL Development, ETL Implementation & Design, ETL Testing, Databases, Database Design, DB, Database Architecture, Database Schema Design

Flask App for Interactive Commands in Slack

https://github.com/joshuahchapman/birders-slackbot
This is a fun hobby project of mine. It's a simple Flask app that runs on Heroku with a Postgres database. It handles interactive commands for a Slack workspace that I created and maintain.

Reporting Data Pipeline Using DBT, Redshift, and Periscope

Redesigned the reporting environment for an insurance startup. They were struggling with performance issues in their reports, due to the use of nested, overly complex views in Periscope and resource contention in Redshift. I chose and implemented DBT to create tables in the database, and used Python to automate the migration of reports to use the new tables.

Migration from Redshift to Snowflake

A financial-services company with very large data volumes wanted to migrate their data warehouse from Redshift to Snowflake while continuing to support many Tableau dashboards that used it. I recreated the key database objects in Snowflake and updated the dashboards to use it.
1998 - 2002

Bachelor's Degree in Computer Science, German Studies

Amherst College - Amherst, MA, USA

Libraries/APIs

Google Sheets API

Tools

Pentaho Data Integration (Kettle), Tableau, Domo, Salesforce Marketing Cloud, Google Sheets, JetBrains, Atom, Git, Apache Airflow, Ansible, Terraform, Hyperion, Talend ETL, Amazon Elastic Block Store (EBS), Stitch Data, Periscope Data, Matillion ETL for Redshift, AWS IAM

Languages

SQL, Snowflake, T-SQL (Transact-SQL), Bash, Stored Procedure, Python

Paradigms

ETL, Business Intelligence (BI), ETL Implementation & Design, Database Design, Agile, Dimensional Modeling

Storage

Database Architecture, DB, Redshift, MySQL, PostgreSQL, SQL Server 2012, Data Lakes, Data Integration, Amazon S3 (AWS S3), Databases, Microsoft SQL Server, SQL Server Reporting Services (SSRS), PL/SQL, Essbase, SQL Server Integration Services (SSIS), Salesforce Commerce Cloud

Platforms

Pentaho, Amazon EC2, MacOS, Linux, Talend, Oracle, Oracle Database, Amazon Web Services (AWS), Google Analytics 360, Visual Studio Code (VS Code)

Other

Data Warehouse Design, Data Warehousing, Data Modeling, Software Development, Data Engineering, Reporting, ETL Development, Database Schema Design, Data Build Tool (dbt), Google BigQuery, MicroStrategy, eCommerce, SSRS Reports, Fivetran, Dashboards, Data Analytics, APIs, ETL Testing, Data Migration, Data Visualization, Relational Database Services (RDS), Epicor, NetSuite, Reports, Batch Scripting, Informatica, Analytics, Amazon Kinesis, Matillion, Mode Analytics, Amazon RDS, AWS Database Migration Service (DMS)

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring