Archit is available for hire

Archit Verma

Verified Expert in Engineering

Data Engineer and Developer

Noida, Uttar Pradesh, India

Toptal member since September 13, 2024

Expertise

Data Warehouse SQL Python Apache Airflow Jenkins AWS Lambda AWS Node.js Data Science Data Engineering Slack Development

Bio

Archit is a seasoned professional with over a decade of hands-on experience in end-to-end data engineering solutions on cloud, data, and API integrations. He is adept at guiding projects from initial estimations through design to implementing fault-tolerant, complex data pipelines for large-scale systems. Archit specializes in utilizing on-premises and cloud-stack services, with expertise in AWS and Azure cloud platforms.

Portfolio

Adobe

Adobe Experience Platform, AWS CloudFormation, AWS Glue, AWS Step Functions...

Experience

Python - 6 years
SQL - 6 years
PySpark - 6 years
Apache Airflow - 6 years
AWS Glue - 5 years
AWS Step Functions - 5 years
Adobe Experience Platform - 4 years
Node.js - 4 years

Availability

Part-time

Preferred Environment

Slack, Mail

The most amazing...

...thing I've done is build a data processing framework to handle the data needs of customers.

Work Experience

Senior Data Engineer

2021 - PRESENT

Adobe

Led the architecture of the Consultant Workbench platform, which is a data analysis platform for data architects within Adobe Consulting. The platform automates the entire data analysis journey by automating tasks on customer data.
Created a GraphQL based API system as a middleware between the front end and back end for the eCommerce platform using Node.js and Adobe I/O Runtime.
Created a framework to automate the data ingestion and data processing using services such as AWS Glue, AWS Lambda, AWS Step Functions, AWS Secrets Manager, and Amazon S3.

Technologies: Adobe Experience Platform, AWS CloudFormation, AWS Glue, AWS Step Functions, Data Engineering, AWS Lambda, SQL, Data Warehouse Design, Data Analytics, Data Warehousing, Data Science

Experience

Consultant Workbench

Consultant Workbench is a data engineering and analysis platform for customer data for global data architects within Adobe Consulting. The platform is developed using resources, primarily Glue, Amazon Elastic Compute Cloud (Amazon EC2), Athena, and Spark. It automates the entire data analysis journey by automating tasks on customer data and creating a metadata repository for each incoming file.

Education

2014 - 2018

Bachelor's Degree in Information Technology

Dr. APJ Abdul Kalam Technical University - Lucknow, India

Certifications

DECEMBER 2022 - PRESENT

Azure Data Engineer Associate

Microsoft

JANUARY 2022 - PRESENT

Adobe Qualified – Adobe Experience Platform

Adobe

MAY 2021 - PRESENT

AWS Certified Cloud Practitioner

Amazon Web Services

Skills

Libraries/APIs

Node.js, PySpark

Tools

Apache Airflow, AWS Glue, AWS Step Functions, Jenkins, AWS CloudFormation, Slack

Languages

SQL, Python

Platforms

AWS Lambda, Adobe Experience Platform, AWS IoT

Other

Data Warehouse Design, Data Warehousing, Data Analytics, Data Engineering, Mail, Computer Science, Data Science

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring