Josh is available for hire
Hire JoshJosh Chapman
Verified Expert in Engineering
Data Warehousing Developer
Location
Los Angeles, CA, United States
Toptal Member Since
June 18, 2020
Josh is an engineering leader and architect with a special passion for data. He's been building data warehouses and reporting platforms for top retailers and eCommerce startups for over a decade. He loves learning and meeting new teams, and he's well-versed in the latest trends and tools in data.
Portfolio
ChowNow
Data Build Tool (dbt), Snowflake, Fivetran, Matillion...
The Honest Company
Amazon Web Services (AWS), Dimensional Modeling, Data Warehouse Design...
Nordstrom
Amazon Web Services (AWS), Data Warehouse Design, Data Warehousing, SQL, Bash...
Experience
Availability
Part-time
Preferred Environment
Git, Atom, JetBrains, Linux, MacOS
The most amazing...
...projects are those that have the biggest impact, not the fanciest code. I've built data warehouses using cheap tools that saved hundreds of person-hours a week.
Work Experience
Director of Data Engineering
2021 - PRESENT
ChowNow
- Hired and managed the first analytics engineering team at the company.
- Built the data pipeline to power the data warehouse used for all company reporting, analytics, and machine learning, primarily using dbt, Fivetran, and Hightouch.
- Built all data structures to support a custom in-house app for the customer experience team, putting crucial analytics in their hands for customer conversations and greatly streamlining their daily workflow.
Technologies: Data Build Tool (dbt), Snowflake, Fivetran, Matillion, Visual Studio Code (VS Code), Python, Tableau, Mode Analytics, Amazon S3 (AWS S3), Amazon RDS, AWS IAM, AWS Database Migration Service (DMS), SQL, APIs, Google Sheets API, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Databases
Senior Manager | Data Engineering
2019 - 2021
The Honest Company
- Built and scaled the company's data warehouse using Amazon Redshift.
- Integrated with new SaaS vendors including Salesforce Commerce Cloud.
- Implemented Airflow for job orchestration, using the Astronomer platform.
- Brought modern data SDLC practices to the data engineering team.
- Rebuilt users' trust in data by fixing reports, implementing clear support procedures, and migrating to a new BI tool.
Technologies: Amazon Web Services (AWS), Dimensional Modeling, Data Warehouse Design, Data Warehousing, Domo, Tableau, SQL, Bash, PostgreSQL, MySQL, Relational Database Services (RDS), Talend, Apache Airflow, Python, Redshift, Data Engineering, Dashboards, Reporting, Data Analytics, APIs, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Data Migration, Databases
Engineering Manager, Data Services
2014 - 2019
Nordstrom
- Scaled up the data warehouse while improving performance and availability.
- Implemented a data lake on AWS using S3, Spectrum, and Spark.
- Scripted all infrastructure provisioning and configuration using Terraform and Ansible.
- Redesigned and rewrote the ETL loading our Amazon Redshift Data Warehouse.
- Built the Data Services team from zero to seven engineers, and served as interim manager for the Mobile Apps Engineering team.
Technologies: Amazon Web Services (AWS), Data Warehouse Design, Data Warehousing, SQL, Bash, MySQL, Terraform, Ansible, Python, Pentaho Data Integration (Kettle), Google BigQuery, Redshift, Data Engineering, Dashboards, Reporting, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Data Migration, Databases
Manager of Data Services
2011 - 2014
ideel
- Led the effort to design and build ideeli's enterprise data warehouse.
- Served as the team's architect and senior developer - designing, building, reviewing, deploying, and supporting ETL jobs, SQL scripts, and reports.
- Led combined onshore and offshore teams in the implementation of MicroStrategy for end-user reporting and analysis.
- Designed the company's ETL architecture from scratch, using Pentaho Data Integration (Kettle) and custom MySQL routines. Led development and production support.
- Designed a key data integration system between the ERP and Warehouse Management systems, using PDI and MySQL.
- Debugged reports in a wide range of technologies: MicroStrategy, Pentaho, MySQL, MS SQL Server, SSAS, MS Access, Excel, Epicor, NetSuite, Talend ETL, Hive, and shell scripts.
Technologies: SQL, Data Warehousing, Data Warehouse Design, Bash, NetSuite, Epicor, Talend, Microsoft SQL Server, MicroStrategy, Pentaho, MySQL, Data Engineering, Reporting, Data Analytics, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, Data Migration, Databases
Software Developer
2009 - 2011
Bridgewater Associates
- Designed and developed the data model, ETL process, and reports for the system used to monitor counterparty exposure. Ran status meetings with sponsors, and managed the project plan (SSIS, T-SQL, SSRS, and AgilePoint).
- Got up to speed on previously unfamiliar business concepts – for instance, developed the database portion of a major new risk-control monitoring tool within a month of joining.
- Played key role in reorg to separate production support from development: designed the training and certification plan for new support associates; improved the procedures for incident handling and escalation; served as lead trainer.
Technologies: SQL, Data Warehousing, Data Warehouse Design, Stored Procedure, SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Microsoft SQL Server, Data Engineering, Reporting, ETL, Business Intelligence (BI), ETL Development, ETL Implementation & Design, ETL Testing, T-SQL (Transact-SQL), Databases
Senior Consultant
2005 - 2008
Palladium Group
- Designed and led the development of a budget analysis application for a leading office supply retailer (MS SQL Server, Hyperion Essbase, Windows Batch Scripting).
- Led redesign of the sales-reporting app for a leading yellow-pages publisher. (Informatica and Oracle).
- Designed and developed database components of a sales reporting and forecasting tool for a major quick-service restaurant company (PL/SQL, Bash, Hyperion Planning, and Hyperion Reports).
Technologies: SQL, Data Warehousing, Data Warehouse Design, Batch Scripting, Bash, Reports, Essbase, Hyperion, PL/SQL, Oracle Database, DB, Oracle, Microsoft SQL Server, Informatica, Data Engineering, Reporting, ETL, ETL Development, ETL Implementation & Design, ETL Testing, T-SQL (Transact-SQL), Databases
Consultant
2003 - 2005
CGI
- Served as a data warehouse developer on a long-term engagement for a large telecom.
- Reviewed requirements and data models, wrote designs, wrote and tested code, and supported production.
- Served as tech lead for the major redesign of an existing marketing data warehouse (Informatica PowerCenter, Oracle PL/SQL, Bash).
Technologies: SQL, Data Warehousing, Data Warehouse Design, Bash, PL/SQL, Oracle Database, Informatica, Data Engineering, ETL, ETL Development, ETL Implementation & Design, ETL Testing, Databases
Experience
Flask App for Interactive Commands in Slack
https://github.com/joshuahchapman/birders-slackbotThis is a fun hobby project of mine. It's a simple Flask app that runs on Heroku with a Postgres database. It handles interactive commands for a Slack workspace that I created and maintain.
Reporting Data Pipeline Using DBT, Redshift, and Periscope
Redesigned the reporting environment for an insurance startup. They were struggling with performance issues in their reports, due to the use of nested, overly complex views in Periscope and resource contention in Redshift. I chose and implemented DBT to create tables in the database, and used Python to automate the migration of reports to use the new tables.
Migration from Redshift to Snowflake
A financial-services company with very large data volumes wanted to migrate their data warehouse from Redshift to Snowflake while continuing to support many Tableau dashboards that used it. I recreated the key database objects in Snowflake and updated the dashboards to use it.
Skills
Languages
SQL, Snowflake, T-SQL (Transact-SQL), Bash, Stored Procedure, Python
Tools
Pentaho Data Integration (Kettle), Tableau, Domo, Salesforce Marketing Cloud, Google Sheets, JetBrains, Atom, Git, Apache Airflow, Ansible, Terraform, Hyperion, Talend ETL, Amazon EBS, Stitch Data, Periscope Data, Matillion ETL for Redshift, AWS IAM
Paradigms
ETL, ETL Implementation & Design, Business Intelligence (BI), Database Design, Agile, Dimensional Modeling
Other
Data Warehouse Design, Data Warehousing, Data Modeling, Software Development, Data Engineering, Reporting, ETL Development, Data Build Tool (dbt), Google BigQuery, MicroStrategy, eCommerce, SSRS Reports, Fivetran, Dashboards, Data Analytics, APIs, ETL Testing, Data Migration, Relational Database Services (RDS), Epicor, NetSuite, Reports, Batch Scripting, Informatica, Analytics, Amazon Kinesis, Matillion, Mode Analytics, Amazon RDS, AWS Database Migration Service (DMS)
Platforms
Amazon EC2, MacOS, Linux, Talend, Pentaho, Oracle, Oracle Database, Amazon Web Services (AWS), Google Analytics 360, Visual Studio Code (VS Code)
Storage
Redshift, MySQL, PostgreSQL, SQL Server 2012, Data Lakes, Data Integration, Amazon S3 (AWS S3), Databases, Microsoft SQL Server, SQL Server Reporting Services (SSRS), DB, PL/SQL, Essbase, SQL Server Integration Services (SSIS), Salesforce Commerce Cloud
Libraries/APIs
Google Sheets API
Education
1998 - 2002
Bachelor's Degree in Computer Science, German Studies
Amherst College - Amherst, MA, USA
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring