
Ankur Kumar
Verified Expert in Engineering
Software Engineer and Developer
Hyderabad, Telangana, India
Toptal member since September 15, 2025
Ankur is a senior software engineer who builds fast, reliable back ends and data pipelines across fintech, eCommerce, and AI. He specializes in Go and Python, designs scalable microservices on AWS and Google Cloud Platform (GCP), and ships observability-driven systems with Kafka, PostgreSQL, and Kubernetes. From optimizing payment flows to orchestrating ML features at scale, Ankur brings calm execution, clear communication, and measurable results.
Portfolio
Experience
- Software - 8 years
- JSON - 8 years
- Python 3 - 8 years
- Microservices - 8 years
- Go - 8 years
- Docker - 6 years
- Kubernetes - 6 years
- Large Language Models (LLMs) - 4 years
Preferred Environment
Looker Studio, GitHub Actions, Kubernetes, Azure, Amazon Web Services (AWS), Apache Kafka, Caching, ClickHouse, PostgreSQL, Databases, Postman, IntelliJ IDEA, Linux, Cloud Storage, Redis, Go, Google Workspace, Slack, Confluence, Jira, GitLab, GitHub, Loki, Grafana, Prometheus, Jenkins, CI/CD Pipelines, Helm, Docker, AWS Lambda, Amazon S3 (AWS S3), BigQuery, Google Kubernetes Engine (GKE), Google Cloud Platform (GCP), NATS, RabbitMQ, Aerospike, IBM MQ, MongoDB, MySQL, Java, Node.js, FastAPI, Python, PyCharm, Visual Studio Code (VS Code), Zsh, Tmux, Bash, Ubuntu, Windows, MacOS, Data Engineering, Data Analysis, Machine Learning
The most amazing...
...system I've built was a Go/Kafka featurization service at Adobe, processing 10,000+ assets per minute with zero data loss.
Work Experience
Senior Software Engineer
Adobe
- Architected a hybrid Go and Python featurization platform using a Go orchestrator and Python FastAPI workers, efficiently processing 10,000+ assets per minute across 12+ models with zero data loss.
- Implemented Go worker-pools with goroutines/channels and Python asyncio pipelines, reducing per-asset wall time by approximately 38% compared to sequential baselines.
- Introduced Kafka for ingestion and back-pressure management, partitioned by asset ID, and scaled consumers linearly to handle fivefold traffic spikes without timeouts.
- Optimized PostgreSQL and BigQuery writes using batched inserts, PgBouncer pooling, and COPY paths, reducing the p99 latency by approximately 35%.
- Enforced idempotency and exactly-once via request keys, transactional outbox, and DLQs, eliminating duplicate processing under retries.
- Instrumented Go and Python with Prometheus, Grafana, and OpenTelemetry, adding per-model latency and lag metrics, and reduced MTTR by over 40%.
- Profiled with Go pprof and Python cProfile/memory_profiler, fixed goroutine leaks and object churn, reducing peak RSS by approximately 25%.
- Deployed on GKE using Docker and Jenkins, with HPA driven by queue depth and CPU, maintaining SLOs during threefold surges without adding extra nodes.
- Implemented schema validation and content hashing in Go ingestion to reject corrupt or oversized inputs early, saving approximately 20% of compute on bad submissions.
- Led blue or green deployments and implemented canary guards with auto-rollback on error spikes, maintaining a release-time failure rate below 0.1%.
Experience
Featurization Service
I defined the ingestion and queuing model, built an orchestrator that explodes each asset into per-model tasks with dependencies, and implemented bounded-concurrency workers with back-pressure, timeouts, retries with exponential backoff, and circuit breakers to protect external model endpoints. I also introduced idempotency keys, an outbox/transactional log to achieve logical exactly-once behavior, and a dead-letter flow for irrecoverable cases.
I also designed the feature schema with versioning and lineage, such as model, version, parameters, and validation gates. I added row-level access controls and audit logs for tenant isolation.
Operationally, I set SLOs, dashboards, and alerts, tuned caching and batching to control costs, and ran load tests to size capacity.
The system handled 10,000+ assets per minute at peak with stable latency and eliminated duplicate model calls via deduplication.
Education
Bachelor's Degree in Computer Science
Shri Mata Vaishno Devi University - Jammu, India
Certifications
Developing Secure Software (LFD121)
The Linux Foundation
Go Essential Training
Data Engineering Foundations
Advanced Python
Skills
Libraries/APIs
Pandas, Node.js
Tools
Spark SQL, AI Prompts, ChatGPT, Tableau, Microsoft Power BI, Looker, Google Workspace, Slack, Confluence, Jira, GitLab, GitHub, Loki, Grafana, Jenkins, Helm, BigQuery, Google Kubernetes Engine (GKE), RabbitMQ, IBM MQ, Postman, IntelliJ IDEA, PyCharm, Tmux, Zsh
Languages
Python 3, Go, Python 2, Python, SQL, C++, Java SE (Core Java), Java, Bash
Frameworks
Spark
Paradigms
Microservices, Database Design, Business Intelligence (BI), HIPAA Compliance, ETL, Compiler Design
Platforms
Azure, Kubernetes, Docker, Apache Kafka, Databricks, AWS Lambda, Amazon Web Services (AWS), Google Cloud Platform (GCP), Visual Studio Code (VS Code), Windows, MacOS, Ubuntu, Linux
Storage
Databases, JSON, PostgreSQL, Data Pipelines, Amazon S3 (AWS S3), Aerospike, Redis, ClickHouse, MongoDB, MySQL
Industry Expertise
Marketing
Other
Data Structures, Algorithms, Machine Learning, FastAPI, Software, Data Engineering, Vector Databases, Large Language Models (LLMs), API Integration, Data Analysis, Data Modeling, Prompt Engineering, Natural Language Processing (NLP), Data Visualization, Metabase, Data Cleansing, ETL Pipelines, Reporting, Supabase, LangChain, Data Build Tool (dbt), AIOps, Discrete Mathematics, Computer Architecture, Networks, Computer Vision, Computer Graphics, Artificial Intelligence (AI), Graph Theory, Security, Pipelines, AI Pipeline, Machine Learning Operations (MLOps), Looker Studio, Prometheus, GitHub Actions, CI/CD Pipelines, Cloud Storage, NATS, Caching, CTO
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring