Shubham is available for hire
Hire ShubhamShubham Agarwal
Verified Expert in Engineering
Python Developer
Bengaluru, Karnataka, India
Toptal member since April 6, 2020
Bio
Shubham Agarwal is an AI engineer with 10+ years of experience in machine learning, NLP, and deep learning. He specializes in retrieval-augmented generation (RAG), multi-agent AI systems, and diffusion models. Proficient in Python, PyTorch, and scalable AI architectures, he has built LLM-powered autonomous agents, graph-based retrieval systems, and production AI workflows, optimizing inference and deploying AI at scale.
Portfolio
Servis One, Inc. t/a BSI Financial Services, Inc.
Artificial Intelligence (AI), Machine Learning...
Empower Education Inc.
Artificial Intelligence (AI), Python, AI Agents, LangChain, FastAPI, Qdrant...
AB InBev
Python, Large Language Models (LLMs), LangChain, Docker...
Experience
- Python - 10 years
- Machine Learning - 8 years
- Data Science - 8 years
- TensorFlow - 6 years
- Large Language Models (LLMs) - 3 years
- Generative Artificial Intelligence (GenAI) - 3 years
- Stable Diffusion - 3 years
Work Experience
AI Lead
2025 - 2025
Servis One, Inc. t/a BSI Financial Services, Inc.
- Built enterprise-grade chatbot for loan and insurance queries with under 1 second latency, custom RAG and hybrid search, and compliance-ready guardrails.
- Engineered a low-latency (less than 1.5 seconds) voice bot using a pipeline consisting of speech-to-text (STT), large language model (LLM), and text-to-speech (TTS), with voice activity detection (VAD), turn detection, and secure enterprise deployment.
- Developed QA automation for voice bot, slashing manual quality assurance/quality control time and ensuring consistent, compliant conversational quality.
Technologies: Artificial Intelligence (AI), Machine Learning, Interactive Voice Response (IVR), AI Agents, AI Chatbots, Product Development, AI Architecture, Agentic AI, Product Engineering, Architecture, Leadership, AI Engineering, LLM Integration, AI Model Training, Machine Learning Operations (MLOps), Solution Architecture, Model Deployment, Enterprise Architecture, Stakeholder Management, Data Architecture, Cloud Architecture, AI Governance, Generative Artificial Intelligence (GenAI), Large Language Models (LLMs), AI Voice Agents, Prompt Engineering, VoiceBot
AI Developer
2024 - 2025
Empower Education Inc.
- Designed and implemented a GraphRAG algorithm for course outline generation based on reference documents. The algorithm constructs a knowledge graph by extracting entities and relationships using small language models (SLMs).
- Developed an agentic architecture similar to Ottogrid, enabling users to design AI workflows. Implemented asynchronous execution and query grouping to optimize search API calls and latency.
- Built a multi-step agentic framework from scratch for orchestrating AI agents. The framework is model-agnostic, supports RAG with the Qdrant database, manages state transitions, and incorporates a human-in-the-loop mechanism.
- Engineered the back-end architecture from scratch using FastAPI, MongoDB, and Beanie. Configured Docker for containerized deployment and deployed on GCP.
- Developed an AI-powered chat agent inspired by Cursor Chat and Windsurf Agents, capable of routing queries to different agents, dynamically planning workflows, and handling ad-hoc queries.
Technologies: Artificial Intelligence (AI), Python, AI Agents, LangChain, FastAPI, Qdrant, Knowledge Graphs, Retrieval-augmented Generation (RAG), Agentic AI, OpenAI, Product Development, AI Architecture, Product Engineering, Architecture, Leadership, AI Engineering, LLM Integration, Machine Learning Operations (MLOps), Solution Architecture, Model Deployment, Enterprise Architecture, Stakeholder Management, Data Architecture, Cloud Architecture, Machine Learning, Generative Artificial Intelligence (GenAI), Large Language Models (LLMs), Prompt Engineering
LLM Specialist
2024 - 2024
AB InBev
- Designed and implemented a robust end-to-end RAG pipeline to process over 100,000 complex PDF documents containing tables, charts, and industrial images, ensuring seamless handling of unstructured data.
- Established a comprehensive evaluation framework for analyzing various query complexities and all stages of RAG, including chunking, retrieval, reranking, and generation, ensuring optimal performance at every step.
- Developed a cutting-edge mixture-of-embedding solution that increased retrieval accuracy by 11%. This hybrid approach combined two types of embeddings with BM25 search, significantly enhancing the retriever.
- Trained and deployed a custom YOLO model for accurate table and figure detection on PDF pages, improving the parsing and processing of millions of PDF documents.
- Reduced overall system latency from 25 seconds to 8 seconds by leveraging efficient open-source models (GLiNER, ColBERT small, BM25), alongside a custom-trained sequence classification model, ensuring faster and more responsive results.
- Engineered an innovative search algorithm capable of running on edge CPU devices, using a combination of BM25 and answerai-colbert-small-v1, delivering performance on par with GPT-4 while maintaining low resource usage.
- Built a robust pipeline to extract structured data from PDF pages and seamlessly integrate it into an SQL database, enabling insights and visualization through a dashboard.
Technologies: Python, Large Language Models (LLMs), LangChain, Docker, Retrieval-augmented Generation (RAG), Product Engineering, Product Development, AI Architecture, Agentic AI, Agentic RAG Systems, Architecture, Leadership, AI Engineering, LLM Integration, AI Model Training, Machine Learning Operations (MLOps), Solution Architecture, Model Deployment, Enterprise Architecture, Stakeholder Management, Data Architecture, Cloud Architecture, AI Governance, Machine Learning, Generative Artificial Intelligence (GenAI), Prompt Engineering
AI Researcher | Founder
2023 - 2024
Zust AI
- Designed an advanced algorithm for background transformation, achieving flawless integration with precise adjustments in shadow, lighting, and subject composition.
- Developed an innovative algorithm to seamlessly swap subject images into existing Midjourney or Stock photos, delivering realistic, high-quality results.
- Recreated Adobe’s Generative Fill algorithm from the ground up, enabling automatic context awareness from the image itself, eliminating the need for user prompts.
- Trained multiple LoRA models to cater to various image generation styles, enhancing versatility and creative output.
- Deployed a containerized solution on AWS, enabling real-time inference and ensuring scalability and efficiency in production.
Technologies: Artificial Intelligence (AI), Generative Artificial Intelligence (GenAI), Python 3, Stable Diffusion, Large Language Models (LLMs), Architecture, Leadership, AI Engineering, LLM Integration, AI Model Training, Machine Learning Operations (MLOps), Solution Architecture, Model Deployment, Enterprise Architecture, Stakeholder Management, Data Architecture, Cloud Architecture, Machine Learning, Prompt Engineering
Python Expert
2022 - 2022
HelloFresh - Data Science - Michael Johnson
- Developed an embedding platform that includes embedding algorithms (graph neural network), recipe recommendation, and batch deployment from scratch.
- Sped up the embedding algorithms and evaluation metrics for recipe recommendations to serve over a million customers.
- Managed end-to-end deployment pipeline: unit testing, Prefect, MLFlow, Git automation, S3, Kubernetes, and extended documentation.
Technologies: Python, Kubernetes, Amazon Web Services (AWS), Apache Spark, TensorFlow, PySpark, DevOps, Architecture, Leadership, Machine Learning Operations (MLOps), Solution Architecture, Enterprise Architecture, Stakeholder Management, Data Architecture, Cloud Architecture, Machine Learning
Senior Back-end Python Developer
2021 - 2022
Invicta Pte Ltd (Toptal Client)
- Designed Python Flask back end for the Kynec application (https://kynec.com). The back end follows Okta-based authentication and multi-tenancy architecture.
- Designed a Redis-based cache mechanism for fast retrieval of the back-end data.
- Designed a mechanism for unit testing and code coverage.
Technologies: Python, Flask, PostgreSQL, Redis, Architecture, Leadership, Machine Learning Operations (MLOps), Solution Architecture, Data Architecture
Data Scientist (via Toptal)
2021 - 2021
Advertise Purple
- Built a statistical model for sales and trend forecasting of eCommerce websites based on the affiliated data. It was an ARIMA-based model developed using the statsmodels Python library.
- Developed a Node.js API to connect the Python back end with the front-end application.
- Performed exploratory data analysis on affiliated data for eCommerce websites and supported the development of a front-end dashboard.
Technologies: Python, Sales Forecasting, Affiliate Marketing, Node.js, StatsModels, Machine Learning Operations (MLOps), Machine Learning
Quant Researcher
2021 - 2021
Valustat
- Designed a pipeline to read financial data into a structured format that can be further filtered and processed on different factors.
- Built factor models, like Fama French, Carhart, and more, for portfolio analysis and asset pricing.
- Designed a Python API to create a custom portfolio based on industry and market data.
Technologies: Python, Quantitative Modeling, Machine Learning Operations (MLOps), Machine Learning
Data Scientist (via Toptal)
2020 - 2020
Truss Investments
- Developed an algorithm to predict the Brazilian futures market using historic and brokers data. An LSTM-based algorithm was developed and implemented using TensorFlow.
- Designed a backtesting algorithm to make decisions of buying or selling based on trade patterns and pricing constraints.
- Developed a Python module to store and structure a large amount of historical pricing data directly used for machine learning models.
Technologies: TensorFlow, Python, Machine Learning Operations (MLOps), Machine Learning
Specialist Developer
2019 - 2020
EzAPI
- Developed a network flow visualization of API inputs and outputs. This helped developers and managers to understand a higher level of API flow and speed up the development process.
- Developed an MVP for API testing automation by parsing a Swagger and OpenAPI specification. Designed test cases based on API inputs and outputs to verify API endpoints.
- Built a virtual mock service for API testing and integration.
Technologies: Natural Language Processing (NLP), Generative Pre-trained Transformers (GPT), Flask, MongoDB, Node.js, Python 3, Data Science, Machine Learning Operations (MLOps), Solution Architecture, Machine Learning
Lead Data Scientist
2017 - 2019
FlexiLoans Technologies, Pvt. Ltd.
- Developed an identity document classifier, like KYC and business documents, using a two-step approach: the Naive Bayes text method and CNN-based object detection.
- Designed a system for face detection and text information retrieval from digital documents using OCR (Optical Character Recognition) for identity verification and data enrichment.
- Built an algorithm to understand the financial and credit-bureau data to construct a loan default prediction model. Many feature engineering, business context, and model ensembling were involved.
- Designed a mathematical model to predict customer financial obligations using credit information. This optimization algorithm predicted two unknown variables from a single equation.
- Automated the overall loan process with a custom-designed Python back end along with Flask and Restful APIs.
- Improved the overall business effectiveness and user experience for lead prioritization and allocation and customer profiling by creating several data-driven applications.
- Conducted an in-house workshop on data thinking and AI.
Technologies: TensorFlow, Scikit-learn, Flask, MongoDB, SQL, Python, Node.js, Machine Learning Operations (MLOps), Solution Architecture, Model Deployment, Stakeholder Management, Data Architecture, Cloud Architecture, Machine Learning
Data Scientist and Software Engineer
2015 - 2017
The Zero Games, Pvt. Ltd.
- Designed an ad-server based on different demographics and time filters. It was a real-time bidding platform that automated the delivery of ads.
- Engineered an ad recommendation system for user targeting and maximizing the click-through rate. The system was designed based on the demographic data and installed applications found on the smartphone.
- Devised a Python back end for a client dashboard to check the daily reach and revenue generated.
Technologies: Scikit-learn, Redis, MongoDB, Node.js, Python
Project History
A Minimal Agentic-loop in Python
https://github.com/shubhdotai/OperonA minimal agentic loop in Python that handles tools in a Unix-style command through a single run(command) tool, so the LLM can chain commands with |, &&, and;. It saves almost 60% in token cost yet improves the tool's recall by 20%,
FastAPI and MLX Offline-first Voice Agent
https://github.com/shubhdotai/offline-voice-ai/tree/mainAn offline-first voice AI agent (that perfectly binds STT, TTS, and LLM model with Silero VAD and a light turn detection model). It's lightning fast and can run sub-second on an edge device. It's optimized for MacOS and leverages MLX, but is not limited to macOS only
Occam-Chess
https://github.com/shubhdotai/Occam-ChessA Rust chess engine around 2750 Elo, built for fast, competitive play. It uses techniques like iterative deepening and alpha-beta pruning to deliver strong play, reaching that strength while thinking for under a second per move.
Education
2010 - 2014
Bachelor of Technology Degree in Computer Science
National Institute of Technology, Raipur - Raipur, India
Certifications
MARCH 2020 - PRESENT
TensorFlow in Practice Specialization
Coursera
OCTOBER 2018 - PRESENT
Deep Learning Specialization
Coursera
Skills
Libraries/APIs
TensorFlow, Pandas, Node.js, NumPy, REST APIs, PyTorch, Scikit-learn, Matplotlib, PySpark, Socket.IO
Tools
Git, StatsModels
Languages
Python 3, Python, SQL, JavaScript, Rust
Frameworks
Django, Express.js, Flask, LlamaIndex, Apache Spark
Platforms
OS X, Google Cloud Platform (GCP), Amazon Web Services (AWS), Linux, Kubernetes, Docker
Storage
Redis, MongoDB, PostgreSQL
Paradigms
DevOps
Other
Machine Learning, Data Science, Data Analysis, Deep Learning, Natural Language Processing (NLP), Scraping, Analytics, Computer Vision, Generative Pre-trained Transformers (GPT), Artificial Intelligence (AI), Generative Artificial Intelligence (GenAI), Stable Diffusion, Large Language Models (LLMs), LangChain, AI Agents, FastAPI, Knowledge Graphs, Retrieval-augmented Generation (RAG), Agentic AI, OpenAI, Interactive Voice Response (IVR), AI Chatbots, Product Development, AI Architecture, Architecture, Leadership, AI Voice Agents, AI Engineering, LLM Integration, Machine Learning Operations (MLOps), Solution Architecture, Model Deployment, Enterprise Architecture, Data Architecture, Cloud Architecture, Prompt Engineering, VoiceBot, Sales Forecasting, Qdrant, AI Model Training, Stakeholder Management, AI Governance, Quantitative Modeling, Affiliate Marketing, Product Engineering, Agentic RAG Systems
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring