
Deepak Arora
Verified Expert in Engineering
Middleware Developer
Irving, United States
Toptal member since September 23, 2026
Deepak is an AI systems architect and forward deployed engineer with 20+ years of experience. At SwifTrade, he translates business challenges into production AI solutions, building LangGraph multi-agent, RAG, and automation systems that scaled fulfillment 6.6x. At Verizon, he built GPU-based Whisper ASR and LLM pipelines across 4M+ devices. He specializes in agentic AI, RAG, LLMs, CUDA inference, and AI architecture.
Portfolio
Experience
- Middleware - 8 years
- Linux - 8 years
- TCP/IP - 8 years
- C - 8 years
- C++ - 8 years
- Bootloaders - 5 years
- Large Language Models (LLMs) - 4 years
- GPU Computing - 3 years
Preferred Environment
Linux, Large Language Models (LLMs), C++, C, Amazon Web Services (AWS), Python 3, OpenCode, Docker, Kubernetes, GitHub
The most amazing...
...thing I've launched is a B2B marketplace. I built AI agents and scaled Amazon orders 6.6x to 2,000 per day, after 20+ years of shipping to 4+ million devices.
Work Experience
Senior AI Systems Architect
SwifTrade
- Selected the GPU/AI infrastructure substrate by benchmark, evaluating stability, cost per GPU-hour, model support, and API-driven provisioning, and built the provisioning path every downstream AI system now runs on.
- Architected and built a multi-agent buyer-acquisition pipeline on a LangGraph state machine, enabling geo-targeted discovery, multi-source contact enrichment, explainable lead scoring, and personalized outreach generation.
- Engineered unit economics directly into the data path by implementing cheapest-first source layering that reaches paid APIs only after free sources are exhausted, response caching with in-flight request coalescing, and cost per acquisition computed.
- Built GPU-accelerated catalog automation for multi-storefront listing generation via lexical and semantic matching with GPU image similarity, plus master-category classification using embeddings and clustering, reducing supplier onboarding from days.
- Designed the output-governance layer for generated outbound content with constrained assembly keeping every claim traceable to a verified source, deterministic pre-send validation with a human review queue, a readiness gate that halts on unsafe.
- Scaled Amazon-channel fulfillment 6.6x on the AI automation layer built. The channel delivered around 300,000 incremental orders over six months against a platform lifetime total past 1 million.
- Built the company-wide model-benchmark framework, scoring coding models and agentic harnesses on cost, code correctness, iterations to convergence, and latency. Standardized the toolchain and an automated code-review loop on the results.
- Took the platform from zero to production in five months through system decomposition, data model design, integration architecture, launch sequencing, established architecture reviews, and AI-assisted development practices.
- Worked as an AI forward deployed engineer (FDE), translating business challenges into production LLM, RAG, and multi-agent solutions. Partnered with stakeholders from rapid prototyping through deployment to deliver measurable impact.
Principal Engineer, Embedded Systems and AI Workflows
Verizon
- Architected and built a Whisper ASR and LLM analysis pipeline on NVIDIA Tesla GPUs to surface field issues early from customer call audio by processing 2,000+ hours of noisy narrowband telephony with CUDA workloads tuned for throughput and cost.
- Delivered comparative data-path analysis behind high-rate ingestion into GPU-accelerated pipelines by evaluating DPDK kernel-bypass versus SmartNIC/DPU offload on latency budgets, throughput ceilings, and hardware cost for the AI compute tier.
- Designed and tuned a DVR high-throughput storage pipeline sustaining 24 parallel I/O streams under heavy disk contention with fragmentation mitigation and write-coalescence algorithms for real-time record and playback.
- Architected an edge-native virtual mobile computing platform as independent R&D with thin-client hardware, Android containerization at the MEC tier, latency-sensitive A/V pipelines, and zero-trust security. Advanced through prototyping.
- Wrote production architecture specifications for thin-client hardware, MEC deployment, security, and A/V pipelines that ODM and internal teams built against. Led delivery across 25+ cross-functional HW/FW/SW teams.
Principal Engineer, Embedded Systems
Verizon
- Designed eMMC flash layouts, boot state machines, and update frameworks that cut update time by approximately 15 seconds.
- Built bootloaders, device drivers, and diagnostics that measurably improved field reliability.
- Established a CI/CD automation pipeline integrated with Gerrit.
- Invented a patented software upgrade and disaster-recovery system that enables reliable bootloader and operating-system upgrades with resilient device recovery.
Senior Embedded Platform Engineer (Contract)
Intel
- Engineered high-performance middleware and Linux kernel modules optimized for memory usage, IPC, networking, and real-time constraints.
- Performed ARM/x86 board bring-up tasks, including MoCA 2.0 driver debugging and eMMC flash architecture work.
- Architected and developed Linux device drivers for onboard sensors and peripherals using I²C, SPI, eMMC, and other hardware interfaces.
Experience
Multi-feed Audio Mixer
https://github.com/deepakaroraembedded-design/AudioMixerThe work is in the plumbing: a pull-based pipeline driven by an injected clock, with four seams (Source, Stage, Sink, ControlSource), clean enough that the file reader, the control input, and the output sink can each be replaced without the mixer noticing.
RESUME-RANKER
https://github.com/deepakaroraembedded-design/ResumeRankerNoun Rank Validation System
https://github.com/deepakaroraembedded-design/Noun-Rank-Validation-SystemEducation
Master's Degree in Computer Science
GGSIP University - New Delhi, India
Bachelor's Degree in Mathematics
Hansraj College, Delhi University - New Delhi, India
Certifications
Virtual Mobile Computing
USPTO
Fundamentals of Quantitative Modeling
University of Pennsylvania
Business Case Development
Harvard
Strategic Thinking
Harvard
Software Upgrade and Disaster Recovery of Computing Devices
USPTO
Skills
Libraries/APIs
FFmpeg, API Development, BigCommerce API, SpaCy
Tools
Git, Claude Code, Whisper, Jenkins, GNU Debugger (GDB), Valgrind, Wireshark, Claude, GitLab, Gerrit, GCC, CMake, OpenCode, GitHub, AI Prompts, ChatGPT
Languages
C, Embedded C, Python, C++, Bash, Embedded C++, Python 3, Assembly, C++17, Go
Platforms
Linux, NVIDIA CUDA, Docker, Amazon Web Services (AWS), Android TV, Embedded Linux, Kubernetes, Google Cloud Platform (GCP), Harness
Frameworks
LangGraph
Paradigms
Automation, Pair Programming, Management
Other
Bootloaders, Middleware, Large Language Models (LLMs), TCP/IP, AI-assisted Development, Artificial Intelligence (AI), Software Architecture, Technical Leadership, LLM Integration, Product Roadmaps, Early-stage Startups, Leadership, AI Integration, API Integration, APIs, Workflow Automation & System Integration, GPU Computing, Embeddings from Language Models (ELMo), clustering, IPMI, Automatic Speech Recognition (ASR), Retrieval-augmented Generation (RAG), Computer Science, Back-end, CI/CD Pipelines, Code Signing, Agentic AI, Go-to-market (GTM) Strategy, Machine Learning, OpenAI, GCP, Mathematics, H.264, Audio / video, Consumer Electronics, Certifications, CPU Boards, MOCA, Bluetooth, Linux Device Driver, flash storage, Oscilloscopes & Tester Equipment, Logic Analyzers, IEEE 802.11, Multithreading, Linux Device Interfaces, Audio Codecs, Transmission Control Protocol (TCP), MPEG-DASH, Graphics Processing Unit (GPU), Embedding Models, Classification, Clustering, Quantitative Modeling, AI Workflow
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring