Josh Chapman
Verified Expert in Engineering
Data Warehousing Developer
Los Angeles, CA, United States
Toptal member since June 18, 2020
Josh is an engineering leader and architect with a special passion for data. He's been building data warehouses and reporting platforms for top retailers and eCommerce startups for over a decade. He loves learning and meeting new teams, and he's well-versed in the latest trends and tools in data.
Portfolio
Experience
- ETL - 20 years
- SQL - 20 years
- Data Warehousing - 20 years
- Data Modeling - 16 years
- Business Intelligence (BI) - 14 years
- Redshift - 5 years
- Snowflake - 4 years
- Apache Airflow - 3 years
Availability
Preferred Environment
Git, Atom, JetBrains, Linux, MacOS
The most amazing...
...projects are those that have the biggest impact, not the fanciest code. I've built data warehouses using cheap tools that saved hundreds of person-hours a week.
Work Experience
Director of Data Engineering
ChowNow
- Hired and managed the first analytics engineering team at the company.
- Built the data pipeline to power the data warehouse used for all company reporting, analytics, and machine learning, primarily using dbt, Fivetran, and Hightouch.
- Built all data structures to support a custom in-house app for the customer experience team, putting crucial analytics in their hands for customer conversations and greatly streamlining their daily workflow.
Senior Manager | Data Engineering
The Honest Company
- Built and scaled the company's data warehouse using Amazon Redshift.
- Integrated with new SaaS vendors including Salesforce Commerce Cloud.
- Implemented Airflow for job orchestration, using the Astronomer platform.
- Brought modern data SDLC practices to the data engineering team.
- Rebuilt users' trust in data by fixing reports, implementing clear support procedures, and migrating to a new BI tool.
Engineering Manager, Data Services
Nordstrom
- Scaled up the data warehouse while improving performance and availability.
- Implemented a data lake on AWS using S3, Spectrum, and Spark.
- Scripted all infrastructure provisioning and configuration using Terraform and Ansible.
- Redesigned and rewrote the ETL loading our Amazon Redshift Data Warehouse.
- Built the Data Services team from zero to seven engineers, and served as interim manager for the Mobile Apps Engineering team.
Manager of Data Services
ideel
- Led the effort to design and build ideeli's enterprise data warehouse.
- Served as the team's architect and senior developer - designing, building, reviewing, deploying, and supporting ETL jobs, SQL scripts, and reports.
- Led combined onshore and offshore teams in the implementation of MicroStrategy for end-user reporting and analysis.
- Designed the company's ETL architecture from scratch, using Pentaho Data Integration (Kettle) and custom MySQL routines. Led development and production support.
- Designed a key data integration system between the ERP and Warehouse Management systems, using PDI and MySQL.
- Debugged reports in a wide range of technologies: MicroStrategy, Pentaho, MySQL, MS SQL Server, SSAS, MS Access, Excel, Epicor, NetSuite, Talend ETL, Hive, and shell scripts.
Software Developer
Bridgewater Associates
- Designed and developed the data model, ETL process, and reports for the system used to monitor counterparty exposure. Ran status meetings with sponsors, and managed the project plan (SSIS, T-SQL, SSRS, and AgilePoint).
- Got up to speed on previously unfamiliar business concepts – for instance, developed the database portion of a major new risk-control monitoring tool within a month of joining.
- Played key role in reorg to separate production support from development: designed the training and certification plan for new support associates; improved the procedures for incident handling and escalation; served as lead trainer.
Senior Consultant
Palladium Group
- Designed and led the development of a budget analysis application for a leading office supply retailer (MS SQL Server, Hyperion Essbase, Windows Batch Scripting).
- Led redesign of the sales-reporting app for a leading yellow-pages publisher. (Informatica and Oracle).
- Designed and developed database components of a sales reporting and forecasting tool for a major quick-service restaurant company (PL/SQL, Bash, Hyperion Planning, and Hyperion Reports).
Consultant
CGI
- Served as a data warehouse developer on a long-term engagement for a large telecom.
- Reviewed requirements and data models, wrote designs, wrote and tested code, and supported production.
- Served as tech lead for the major redesign of an existing marketing data warehouse (Informatica PowerCenter, Oracle PL/SQL, Bash).
Experience
Flask App for Interactive Commands in Slack
https://github.com/joshuahchapman/birders-slackbotReporting Data Pipeline Using DBT, Redshift, and Periscope
Migration from Redshift to Snowflake
Education
Bachelor's Degree in Computer Science, German Studies
Amherst College - Amherst, MA, USA
Skills
Libraries/APIs
Google Sheets API
Tools
Pentaho Data Integration (Kettle), Tableau, Domo, Salesforce Marketing Cloud, Google Sheets, JetBrains, Atom, Git, Apache Airflow, Ansible, Terraform, Hyperion, Talend ETL, Amazon Elastic Block Store (EBS), Stitch Data, Periscope Data, Matillion ETL for Redshift, AWS IAM
Languages
SQL, Snowflake, T-SQL (Transact-SQL), Bash, Stored Procedure, Python
Paradigms
ETL, Business Intelligence (BI), ETL Implementation & Design, Database Design, Agile, Dimensional Modeling
Storage
Database Architecture, DB, Redshift, MySQL, PostgreSQL, SQL Server 2012, Data Lakes, Data Integration, Amazon S3 (AWS S3), Databases, Microsoft SQL Server, SQL Server Reporting Services (SSRS), PL/SQL, Essbase, SQL Server Integration Services (SSIS), Salesforce Commerce Cloud
Platforms
Pentaho, Amazon EC2, MacOS, Linux, Talend, Oracle, Oracle Database, Amazon Web Services (AWS), Google Analytics 360, Visual Studio Code (VS Code)
Other
Data Warehouse Design, Data Warehousing, Data Modeling, Software Development, Data Engineering, Reporting, ETL Development, Database Schema Design, Data Build Tool (dbt), Google BigQuery, MicroStrategy, eCommerce, SSRS Reports, Fivetran, Dashboards, Data Analytics, APIs, ETL Testing, Data Migration, Data Visualization, Relational Database Services (RDS), Epicor, NetSuite, Reports, Batch Scripting, Informatica, Analytics, Amazon Kinesis, Matillion, Mode Analytics, Amazon RDS, AWS Database Migration Service (DMS)
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring