
Will Gao
Verified Expert in Engineering
AI/ML Engineer and Developer
Atlanta, GA, United States
Toptal member since July 11, 2025
Will is an experienced AI and machine learning architect and engineer with seven years of expertise designing, implementing, and deploying data- and AI-driven solutions. Skilled at framing generative AI and machine learning projects across diverse industries, he excels at architecting production systems and improving product and engineering alignment. As a systems thinker, Will has successfully led a consulting practice to deliver impactful results.
Portfolio
Experience
- Python - 8 years
- Amazon Web Services (AWS) - 7 years
- Machine Learning - 7 years
- Machine Learning Operations (MLOps) - 5 years
- Artificial Intelligence (AI) - 3 years
- Agentic AI - 2 years
- AIOps - 2 years
- Retrieval-augmented Generation (RAG) - 2 years
Preferred Environment
Slack, Python, Terraform, Amazon Web Services (AWS), LangChain, FastAPI, GitHub
The most amazing...
...accomplishment was turning around multiple at-risk data and AI projects, restoring client satisfaction, and preventing a potential six-figure revenue loss.
Work Experience
AI and Machine Learning Architect
RapidScale Inc.
- Led the development of a new AI and machine learning (ML) consulting practice, enabling the company to achieve AWS Generative AI Competency in just 15 months.
- Rescued multiple at-risk AI and data projects by aligning strategic AI thinking with business context, stakeholder priorities, and resource planning—turning around dissatisfied clients and averting six-figure revenue losses.
- Authored internal process documentation and consulting assets to formalize the AI and ML delivery lifecycle and refined them through cross-functional feedback, enabling sustainable, high-impact execution with teams as small as one or two people.
- Established a rapid-response hiring and onboarding pipeline during a team attrition crisis, quickly restoring headcount and ensuring client delivery timelines and expectations were met.
- Designed and implemented a streamlined onboarding process that enabled new hires to become billable contributors within one week of joining.
- Architected and delivered multiple retrieval-augmented generation systems using technologies such as LangChain, LangGraph, LlamaIndex, FastAPI, Amazon Bedrock, and OpenSearch to support enterprise knowledge workflows.
- Built custom document ingestion pipelines by integrating open-source and commercial tools, improving retrieval relevance and ingestion throughput.
- Designed and built client-specific machine learning operations pipelines using the Amazon SageMaker ecosystem, covering model training, deployment, and continuous integration and delivery.
- Conducted AI and machine learning maturity assessments and facilitated roadmap workshops, aligning technical solutions with product strategy for early-stage and enterprise clients.
- Fostered a high-trust, high-autonomy team culture that maintained delivery quality amid staffing shortages and project volatility.
Senior Machine Learning Engineer
Triumph Technology Solutions
- Architected and deployed a production MLOps system orchestrated with Amazon Managed Workflows for Apache Airflow (Amazon MWAA) and SageMaker Pipelines, using Terraform for deployment.
- Spearheaded the implementation of a content recommendation system for a mental health nonprofit, aligning business outcomes with approaches driven by human-centric metrics.
- Architected and built a restaurant labor forecasting solution using Amazon Forecast, orchestrated with AWS Step Functions.
Data Scientist & Senior Data Scientist
Cox Communications
- Built and deployed advanced graph analytics applications to production on AWS, serving real-time or near-real-time insights of the massive network.
- Developed predictive model POCs across ML domains like NLP, classification, and unsupervised learning to support service health initiatives, leveraging terabyte-scale complex datasets.
- Piloted best practices of model deployment in AWS for the Center of Excellence.
- Built and maintained reusable, cloud-based internal tools for data science tasks such as EDA and data visualization that accommodated enterprise data requirements.
Experience
Agentic AI Assistant for Course Generation
Using LangChain and LlamaIndex as the core RAG technologies, the platform retrieves relevant knowledge for each learning module and drives text generation pipelines. I implemented FastAPI to serve the RAG endpoints, while Amazon Bedrock hosts the underlying large language models.
To maintain a consistent tone and pedagogical style, I designed custom prompt engineering logic. Additionally, I built analytics pipelines to measure content coherence and track student engagement signals. Through iterative improvements, I increased coherence scores by 35%.
Agentic AI Assistant for Document Editor Platform
Users can select multiple reports, and the system iteratively aggregates summaries across similar chunks. This enables AI to generate cohesive templates across sections, capturing common patterns and producing structured outputs.
I built the ingestion pipeline using PDF parsing combined with optical character recognition (OCR) and chunking and vector indexing in OpenSearch. Leveraging LangGraph and LangChain, I implemented multitiered retrievers and a self-reflective agentic flow. FastAPI serves the search, summary, and template-generation endpoints.
This modular architecture enables users to generate high-quality draft templates from five to ten reports in under three minutes.
MLOps System for SaaS Platform
To ensure reliability and reproducibility, I provisioned infrastructure using Terraform and integrated monitoring and CI/CD hooks to support model lifecycle management. The pipeline was designed to scale with minimal manual intervention, enabling rapid iteration while maintaining high observability and control.
This system powers clients' NLP and classification use cases, allowing clients to iterate on models quickly, reducing time-to-production from days to minutes.
Education
Master's Degree in Computational Science and Engineering
Georgia Institute of Technology - Atlanta, GA, USA
Certifications
Professional Machine Learning Engineer
Google Cloud
AWS Machine Learning Specialty
Amazon Web Services
Skills
Tools
Slack, Amazon SageMaker, GitHub, Terraform, AWS Step Functions, Amazon OpenSearch
Languages
Python, SQL
Frameworks
LangGraph, LlamaIndex
Platforms
Amazon Web Services (AWS), AWS Lambda, Vertex AI
Storage
Elasticsearch, Graph Databases
Other
LangChain, FastAPI, Machine Learning, Machine Learning Operations (MLOps), Artificial Intelligence (AI), Process Improvement, Retrieval-augmented Generation (RAG), Agentic AI, Generative Artificial Intelligence (GenAI), AIOps, Big Data, Cloud Engineering, AWS Bedrock AgentCore, Advisory, AI Agents, AI Adoption, Software Architecture, Feasibility Studies, Large Language Models (LLMs), Supervised Machine Learning, Chatbots, Amazon Managed Workflows for Apache Airflow (MWAA), Software Engineering, Algorithms, API Design, Data Labeling, Natural Language Processing (NLP), Legal Technology (Legaltech), Recommendation Systems, Data Engineering, Cloud Architecture
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring