Cuong Dang, Developer in Waverly, IA, United States
Cuong is available for hire
Hire Cuong

Cuong Dang

Verified Expert  in Engineering

Data Engineering Developer

Location
Waverly, IA, United States
Toptal Member Since
November 14, 2022

Cuong is a well-rounded data engineer who delivers complete solution packages, including design, code, documentation, testing, and infrastructure. He is passionate about theory and practice and commits to lifelong learning, especially in computer science and mathematics. One of Cuong's highlightable experiences includes a scalable system that migrated data from on-premise databases to a cloud data lake. He is also proficient in back-end development.

Portfolio

Curvo Labs
Scala, TypeScript, Python, SQL, AWS Step Functions, AWS Lambda, Terraform...
Techcombank
Scala, Java, Python, SQL, Spark, AWS Glue, AWS Lambda, Apache Airflow...

Experience

Availability

Part-time

Preferred Environment

Scala, SQL, AWS Step Functions, Terraform, Spark, AWS Glue, AWS Lambda, Bash

The most amazing...

...system I've designed and implemented is a data system migrating thousands of tables from on-premise to the cloud for one of the largest banks in the country.

Work Experience

Senior Data Engineer

2022 - PRESENT
Curvo Labs
  • Developed and maintained the company's data platform, including core processing and serving pipelines with all infrastructure as code.
  • Designed and developed a nonlinear regression with a Spark data pipeline to calculate potential savings likelihoods.
  • Created back-end APIs for product features and standard libraries for other developers.
Technologies: Scala, TypeScript, Python, SQL, AWS Step Functions, AWS Lambda, Terraform, AWS Glue, Spark, NestJS, PostgreSQL, Docker, CircleCI, Git, Data Engineering

Data Engineer

2020 - 2022
Techcombank
  • Designed and implemented a system that migrated data from on-premise databases to a cloud data lake that scaled to the scheduled pulling of thousands of tables with different change-data-capture patterns and throughput requirements.
  • Created operations processes and implemented validation for ad-hoc file upload.
  • Gathered requirements; designed and built an end-to-end BI performance tracking dashboard that ingested and processed data from multiple heterogeneous sources.
Technologies: Scala, Java, Python, SQL, Spark, AWS Glue, AWS Lambda, Apache Airflow, PostgreSQL, JanusGraph, Docker, Microsoft Power BI, Apache Beam, Git, Data Engineering, Data Visualization

On-premise to Cloud Data Migration System

A data migration system that scaled to scheduled pulling of thousands of tables from multiple on-premise databases to the cloud data lake's landing zone. I was the primary designer and implementer of the system.

The goal was to maximize automation that allows Data Operations staff to add source data tables to be loaded quickly. The system was composed of the main components:
• Directed Acyclic Graph (DAG) Generator—induced Airflow DAGs.
• Extractor—pulled data from sources based on different specified change-data-capture (CDC) patterns.
• Uploader—picked up data from buffer storage and loaded them to the cloud landing zone.
• Validator— validated files in file upload jobs.

Languages

Scala, TypeScript, Python, SQL, Java, C, Scheme

Frameworks

Spark, NestJS

Tools

AWS Step Functions, AWS Glue, Microsoft Power BI, CircleCI, Git, Terraform, Apache Airflow, Apache Beam

Platforms

AWS Lambda, Docker

Storage

PostgreSQL, JanusGraph

Other

Data Engineering, Data Visualization

2008 - 2014

Bachelor's Degree in Economics

Yonsei University - Seoul, South Korea

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring