Jon Scott, Developer in Newcastle-under-Lyme, United Kingdom
Jon is available for hire
Hire Jon

Jon Scott

Verified Expert  in Engineering

Architect and Database Developer

Location
Newcastle-under-Lyme, United Kingdom
Toptal Member Since
March 15, 2021

Jon is a data consultant dedicated to helping his customers fulfill their goals. He has extensive experience designing and building large-scale big data solutions for enterprises through to small systems for startup companies. He assists clients at all stages of their growth to exploit the value held in their data. Jon's technical expertise and business acumen come together to give clients the best experience of design, implementation, and long-term value.

Portfolio

Goalcast
Amazon Athena, Apache Airflow, Amazon QuickSight, Python, Data Engineering...
Marketing Attribution Partners
Data, Python, PyMC3, Data Warehouse Design, Django, SQL, PostgreSQL, NumPy...
Pharma Data Company
Apache Airflow, Code Architecture, SQL, Redshift, Amazon Redshift Spectrum...

Experience

Availability

Part-time

Preferred Environment

Linux, PostgreSQL, Amazon Web Services (AWS), Amazon Athena, Data Lake Design, Data Lakes, Data Warehouse Design, Redshift, Python 3, Apache Airflow, Data Engineering, Data Modeling, Data Analysis, ETL, Data Warehousing, Data Architecture, Big Data Architecture, Architecture

The most amazing...

...product I have designed and built is a SaaS solution for a marketing attribution company. This included industry leading analytics and blistering speed.

Work Experience

Architect and Data Engineer

2020 - PRESENT
Goalcast
  • Designed an architecture to capture, analyze, and dashboard social media posts and videos. Complex data and reporting requirements had to be met.
  • Tracked features and bugs using Jira and created technical specifications based upon client requirements.
  • Built complex ETL flows to manage the transformations using Athena.
  • Built user friendly dashboards in AWS Quicksight to enable users to explore the data.
Technologies: Amazon Athena, Apache Airflow, Amazon QuickSight, Python, Data Engineering, Data Science, Machine Learning, Data Reporting, Data Modeling, Data Analysis, Business Intelligence (BI), Microsoft Excel, ETL, Data Warehousing, Data Architecture, Big Data Architecture, Architecture, Roadmaps

Technical Lead

2018 - PRESENT
Marketing Attribution Partners
  • Designed the architecture to meet requirements. Iteratively enhanced this as requirements increased in a managed way over time.
  • Built the data model system service using PostgreSQL and Python (PyMC3), leading edge technology for marketing analysis.
  • Built the data model and Django back-end API service for a SaaS solution to surface the model.
  • Led the expansion of the team with processes to manage the quality and specification. Used Jira system to build an Agile CI/CD process. Managed team on a day-to-day basis.
  • Enhanced the data processing with a 100x speed performance boost using low level Python (NumPy) to replace an intensive mechanism previously performed in SAS.
Technologies: Data, Python, PyMC3, Data Warehouse Design, Django, SQL, PostgreSQL, NumPy, Data Engineering, Data Reporting, Data Modeling, Data Analysis, Business Intelligence (BI), Microsoft Excel, ETL, Data Warehousing, Data Architecture, Architecture, Roadmaps

Lead Architect

2020 - 2021
Pharma Data Company
  • Designed and communicated a novel ETL architecture to meet exacting requirements around data provenance, quality, security, and performance.
  • Built the project plan and engaged with the development teams to ensure alignment. Managed the work alongside the program manager using Jira.
  • Developed solutions to overcome complex edge cases to ensure smooth running of the system and to allow the project to be completed. Using SQL and PySpark.
  • Supported implementation and quality assurance while the system was embedded.
Technologies: Apache Airflow, Code Architecture, SQL, Redshift, Amazon Redshift Spectrum, AWS Glue, Data Lake Design, SAS, Data Engineering, Data Science, Machine Learning, Data Reporting, Data Modeling, Data Analysis, MySQL, Business Intelligence (BI), Microsoft Excel, ETL, Data Warehousing, Data Architecture, Big Data Architecture, Architecture

MI Manager

2013 - 2015
Bet365
  • Led the development of analytics and business reporting (a team of six data engineers) and the micro-strategy reporting team.
  • Led the enhancement of ETL processes to meet tighter timescales and more features.
  • Worked on legal and compliance reporting across geographies to help roll out services worldwide.
Technologies: Data Warehouse Design, ETL Tools, SQL, WordPress, Bolt CMS, Data Engineering, Machine Learning, Data Reporting, Data Modeling, Data Analysis, MySQL, Business Intelligence (BI), ETL, Data Warehousing, Data Architecture, Big Data Architecture, Architecture, Roadmaps, Financial Data

Lead BI Architect

2009 - 2013
Capgemini
  • Served as senior architect within Capgemini UK BIM (Business Information Management) practice. Communicated regularly with stakeholder management at partner (VP) level within Capgemini and at the senior executive level within the customer organization.
  • Oversaw solution design for Capgemini customers, specializing in public sector. Significant customer stakeholder management and pre sales activity, including sales strategy and solution design work for large scale data solutions.
  • Collaborated with partners including Cloudera to ensure optimal solution design. Fed back into open source community where possible.
Technologies: Data Warehouse Design, SQL, Teradata, Hadoop, Cloudera, Data Analysis, ETL, Data Warehousing, Data Architecture, Architecture, Financial Data

BCV Social Platform

Designed and technically managed the build of a data analytics solution for managing social media reporting for clients of BCV social. Managed data flows to ensure data quality and low latency. Created a reporting back-end API used by the front-end reporting system.

Languages

Python 3, Python, SQL, SAS

Frameworks

Django, Hadoop

Tools

Amazon Athena, Amazon Redshift Spectrum, Amazon QuickSight, Microsoft Excel, Apache Airflow, AWS Glue, Cloudera, Bolt CMS

Paradigms

Business Intelligence (BI), ETL, Data Science

Platforms

Amazon Web Services (AWS), Linux, WordPress

Storage

PostgreSQL, Data Lake Design, Data Lakes, Redshift, MySQL, Teradata

Other

Data Warehouse Design, Data, Data Analytics, Data Engineering, Data Reporting, Data Modeling, Data Analysis, Data Warehousing, Data Architecture, Big Data Architecture, Architecture, Roadmaps, Code Architecture, Dashboard Design, Machine Learning, Financial Data, PyMC3, ETL Tools

Libraries/APIs

NumPy

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring