
Prathamesh Saraf
Verified Expert in Engineering
Artificial Intelligence Engineer and Developer
Bengaluru, Karnataka, India
Toptal member since October 6, 2025
Prathamesh is an AI engineer with deep expertise in building LLM-powered applications, scalable APIs, and data intelligence systems. With experience spanning research, startups, and open-source projects, Prathamesh bridges advanced machine learning with practical, business-driven solutions.
Portfolio
Experience
- FastAPI - 5 years
- Python 3 - 5 years
- AI Agents - 4 years
- Artificial Intelligence (AI) - 4 years
- Large Language Models (LLMs) - 3 years
- Retrieval-augmented Generation (RAG) - 3 years
- Agentic AI - 2 years
- Google ADK - 1 year
Preferred Environment
MacOS, Visual Studio Code (VS Code), Slack
The most amazing...
...thing I've completed is help Fortune 5 enterprise ship production grade GenAI
Work Experience
AI Prompt Engineer with Claude and Multi-Agent Workflow Experience
LG NOVA - New Ventures
- Led end-to-end development of an AI course-generation platform, shipping 150+ changes across ~380 files (+53K lines) and 13 releases in 4 months, turning raw PDFs and web pages into complete interactive learning experiences.
- Built an AI learning assistant answering learner questions in real time from course material, returning source-cited answers via a hybrid retrieval engine tuned to 2,000 requests/minute, backed by a feedback-driven evaluation harness.
- Automated the full multimedia pipeline, auto-generating narrated videos, AI-presenter videos, 10 slide formats, and 5 diagram types from source content, cutting course production from days of manual work to minutes.
- Raised content quality and trust with an automated evaluation system scoring every course for factual accuracy and instructional depth, hardened by 30+ tests catching calculation and rendering errors before learners see them.
- Drove cost visibility and organic growth via per-course cost tracking with an admin analytics dashboard plus shareable, socially-optimized course pages with one-click content export.
Applied AI Consultant
CVS Health
- Led the development of an organization-wide outbound campaign management system that uses an AI voice agent pipeline for seamless SIP outbound campaigns.
- Partnered with data science and product teams to ensure seamless deployment of AI models within a regulated healthcare environment, maintaining compliance and security.
- Oversaw the development of the generative AI stack, integrating agentic workflows, RAG pipelines, and LLM fine-tuning to enhance analytics and customer engagement at enterprise scale.
- Published a technical article on: Transforming Customer Interactions: Evolving IVR Systems in CVS Health Tech Blog.
- Revamped legacy IVR systems using AI-driven agentic pipelines, improving customer query resolution rate to 95% and reducing average handling time.
- Delivered AI and agentic stack training to product leaders and enterprise teams, while contributing to strategic planning and roadmap execution for production-grade AI systems.
Senior Software Engineer
TrueFoundry
- Led the development of Cognita, an open-source RAG framework that has earned 3,000+ GitHub stars, which is now used by enterprise teams to build context-aware AI systems.
- Worked as a solutions architect for Truefoundry clients as part of the Enterprise Outcome team, such as Merck, Otsuka, Siemens, to ensure the successful delivery of outcomes from a data science perspective.
- Maximized product adoption, ensured a smooth integration of the TrueFoundry product, and closed the customer feedback loop.
AI Engineer
Cogentic Labs Inc.
- Architected and deployed a multi-agent natural language database query system, reaching 70-80% faster response times and 65% cost reduction through intelligent query classification, Redis caching, and zero database load for conversational follow-ups.
- Designed a secure SQL payload generation architecture replacing direct database access, implementing role-based access control, multi-tenant data isolation, and comprehensive validation to prevent SQL injection across the enterprise platform.
- Built a database-agnostic configuration system using YAML schemas, enabling deployment to any PostgreSQL database without code changes, reducing set-up time from days to hours for new environments.
Founding Engineer | Technical Lead
Chatowl
- Spearheaded the design and implementation of the technical and product stack for ChatOwl’s therapeutic sessions, playing a pivotal role in shaping the product roadmap.
- Orchestrated seamless collaboration between multiple teams, ensuring the timely delivery of multiple successful product releases.
- Tackled a diverse array of challenges spanning conversational AI, Databases, back-end development, LLMs, and DevOps.
- Demonstrated strategic thinking, research skills, quick adaptability to emerging technologies, and the ability to devise innovative solutions that yielded both monetary and technical advantages.
Junior Chatbot Developer
Saarthi
- Designed, developed, and maintained multilingual text and IVR-based chatbots.
- Worked extensively on RASA and modified its open-source code to set up automated testing for conversations, which improved the testing effort by 50%.
- Set up analytics services for chatbots that help in generating business leads, that help grow business outreach by 20%.
- Containerized and set up a serverless environment for deployment, which saved the cloud cost by 15% compared to a normal VM deployment.
Experience
My Adventures with Large Language Models
https://leanpub.com/adventures-with-llmsMCP Registry & Playground
https://mcps.truefoundry.comSetu - UPSC Current Affairs & AI MCQ Platform
https://setu.prathameshsaraf.comsuper-hype: Human-in-the-Loop Employee Advocacy Platform
https://github.com/S1LV3RJ1NX/superHypeYukti – LLM-powered Data Intelligence Platform
Yukti empowers analysts, business leaders, and operations teams to explore documents, reports, and databases without needing technical skills—accelerating decision-making and improving productivity across enterprises.
CARL: Cost-optimized Online Container Placement on VMs Using Adversarial Reinforcement Learning
https://ieeexplore.ieee.org/document/10839070We proposed CARL, a novel Adversarial Reinforcement Learning (RL) approach for cost-efficient container placement. CARL mimics the behavior of an offline semi-optimal VBP solver (teacher) while automatically learning a reward function that minimizes VM costs and outperforms the teacher’s performance. It requires minimal historical workload traces and remains resilient to distributional shifts during inference.
We evaluated CARL on large-scale workloads derived from Google and Alibaba traces, placing 5,000-10,000 container requests across 2,000-8,000 VMs. CARL achieved approximately 1,900 placement decisions/sec, delivered approximately 16% lower VM costs than state-of-the-art methods, and maintained robustness under varying resource and workload conditions, demonstrating real-time, scalable efficiency for modern cloud orchestration.
AIME – AI Meeting Intelligence & Analysis Platform
Leveraging agentic AI workflows, AIME enables sales teams to uncover customer intent, improve communication effectiveness, and close deals faster. The platform’s modular design allows enterprises to customize workflows, integrate CRMs, and scale AI inference seamlessly across teams.
Algorithmist | Teaching Channel for DSA
https://www.youtube.com/c/AlgorithmistcoderEducation
Master's Degree in Computational and Data Sciences
Indian Institute of Science - Bangalore, India
Certifications
Claude Certified Architect - Foundations
Claude
Building Knowledge Graphs with LLMs
Neo4j
Build intelligent agents with Agent Development Kit (ADK)
Google Cloud
CodeChef Certified Data Structures and Algorithms (CCDSA) Foundation Level
CodeChef
Skills
Libraries/APIs
API Development, REST APIs, Pydantic, Python Asyncio, Llama API, OpenAI API, Asyncio, Node.js, TensorFlow, PyTorch, Claude API, Twilio API, Hugging Face Transformers, React, Rasa NLU, vLLM, SQLAlchemy, Slack API
Tools
Slack, Claude, ChatGPT, Microsoft Copilot, Claude Code, Docker Compose, DeepSeek, Azure OpenAI Service, Claude Agent SDK, Visual Language Models (VLMs), Rasa.ai, Celery, Grafana, n8n, Microsoft Excel, Amazon SageMaker, Amazon Elastic Container Service (ECS), LaTeX, Draw.io, Shadcn
Languages
Python 3, Python, SQL, JavaScript, TypeScript, C, C++, YAML
Frameworks
LangGraph, Agentic Frameworks, LlamaIndex, Django, Next.js, Alembic, OAuth 2, JSON Web Tokens (JWT), Tailwind CSS
Paradigms
Functional Analysis, Model Context Protocol (MCP), Role-based Access Control (RBAC), Automation, Microservices, Best Practices, Synthetic Data Generation, REST, HIPAA Compliance, DevOps
Platforms
MacOS, Visual Studio Code (VS Code), LiveKit, Docker, Vertex AI, Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP), Twilio, Ollama, NVIDIA CUDA, Linkedln
Storage
JSON, PostgreSQL, MongoDB, Data Pipelines, Database Structure, Amazon S3 (AWS S3), Neo4j, Databases, Graph Databases
Industry Expertise
Cybersecurity
Other
Artificial Intelligence (AI), FastAPI, Large Language Models (LLMs), Agentic AI, Google ADK, LangChain, Retrieval-augmented Generation (RAG), APIs, AI Model Integration, Conversational AI, AI Model Training, Machine Learning, AI Agents, AI Chatbots, Prompt Engineering, Chatbot Conversation Design, Multi-agent Systems, AI Voice Agents, Generative Artificial Intelligence (GenAI), ChatGPT Prompts, Natural Language Processing (NLP), Vector Databases, OpenAI, API Integration, Chatbots, Leadership, Research, Optical Character Recognition (OCR), Model Tuning, AI Integration, PDF, OpenAI GPT-4 API, Text-to-Speech (TTS), Business Analysis, Cursor AI, Software Architecture, Sentiment Analysis, Anthropic, AI Tools, Document Processing, Large Language Model Operations (LLMOps), Multimodal GenAI, Local Hosting, Generative Pre-trained Transformers (GPT), Hugging Face, Open-source LLMs, AI Assistants, Troubleshooting, Small Language Models (SLMs), Fine-tuning, Llama 3, Gemini, RAG Architecture, Meta Llama, Agentic RAG Systems, Speech-to-Text (STT), RAG Pipelines, ChatGPT API, RAG Systems, AI Architecture, Training, Conversational Agent, Cartesia, Deepgram, Agentic AI Systems, API Design, Reinforcement Learning, Cloud, Voice Chat, Data Structures, Algorithms, Natural Language Queries, Machine Learning Operations (MLOps), Data Science, Evaluation, Gemma API, Reinforcement Learning from Human Feedback (RLHF), Data Analysis, ChromaDB, Data Annotation, Data Labeling, AI Data Classification, Webhooks, Healthtech, Design, Dashboards, Health, Executive Consulting, Architecture, Web Scraping, AI Modeling, Google Colaboratory (Colab), Technical Project Management, Pattern Analysis, Platform as a Service (PaaS), Software Development Lifecycle (SDLC), AI Automation, PDF Scraping, Vector Search, Multimodal Models, FAISS, Deep Learning, Solution Architecture, Workflow, Gmail, Workflow Automation & System Integration, Psychology, Firecrawl, Mistral AI, Multistage LLM Chains, LoRa, Qwen, Prototyping, Semantic Search, Distributed Systems, Data Protection, Workflow Automation, Back-end Development, Technical Leadership, Web Development, Amazon Bedrock, Automatic Speech Recognition (ASR), Model Evaluation, Bots, Data Management, Data Analytics, SaaS, Weaviate, Neural Networks, AI Copilots, IT Project Management, IT Projects, AI Consulting, Decision Modeling, Embedding Models, ElevenLabs Solutions, Automations, AI Systems, Knowledge Graphs, Vector Data, Qdrant, Prometheus, Pinecone, Deep Reinforcement Learning, Generative Adversarial Networks (GANs), Virtual Machines, Actor-critic Methods (A2C, A3C), Visualization, Amplitude, Front-end Development, Data Architecture, Data Engineering, Image Processing, AI Security, Natural Language Understanding (NLU), ARQ, Slackbot, GitOps, GitHub Actions, Context Management, Generative AI Architecture, Multi-agent Orchestration, Production reliability, Tool & MCP Design
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring