
Mushirul Aman
Verified Expert in Engineering
Data and AI Engineer and Developer
Bengaluru, Karnataka, India
Toptal member since August 31, 2026
Mushirul is a lead data and AI engineer who doesn't just build data systems–he builds the ones Fortune 500 companies rely on. With 8+ years at PwC and Deloitte, he's shipped real-time pipelines, GenAI platforms, and cloud-native architectures for Mastercard, Netflix, Google, PepsiCo, Chevron, and Verizon with no missed deadlines or audit failures. Mushirul brings a proven track record of delivering data platforms that perform reliably at scale.
Portfolio
Experience
- PySpark - 8 years
- Data Modeling - 8 years
- Forward Deployed Engineering (FDE) - 8 years
- AI Engineering - 8 years
- Data Engineering - 8 years
- Databricks - 7 years
- Data & AI Architect - 7 years
- LLM Fine-tuning - 6 years
Work Experience
Lead Data and AI Engineer
rearc.io
- Directed the design of a petabyte-scale, AI-ready data lakehouse, ingesting 500+ million member interaction events daily across search and browse signals and serving as the single training source for 12 recommendation and ranking ML models.
- Provisioned an LLM-powered enrichment pipeline using GPT-4 and LangChain across 80,000+ titles, auto-generating genre tags, mood attributes, and semantic embeddings, improving cold-start recommendation precision by 18% for new-member onboarding.
- Architected AWS/Databricks Clean Rooms and Snowflake Data Sharing for cross-merchant analytics without exposing raw data, achieving first-cycle PCI-DSS Level 1 and CCPA compliance across 15+ partner institutions.
Lead Data and AI Engineer
R Systems
- Spearheaded a cross-functional team of six engineers across data engineering, analytics, and platform to deliver a governed enterprise data ecosystem from design through production.
- Architected enterprise-wide Data Vault 2.0 platform on Snowflake, consolidating 120+ KPIs into a single source of truth for C-level reporting, improving accuracy by 30% and eliminating metric inconsistencies across departments.
- Reduced manual reporting effort by 60% through automated data discovery layers and self-service BI with Power BI and Tableau.
- Implemented row-level security and regulatory governance frameworks, achieving zero audit failures across SEC and SOC-2 reviews.
- Built layered dbt transformation pipelines with automated CI/CD across development, QA, and production environments.
Senior Associate, Data and AI Engineering
PwC
- Directed a team of eight engineers and three data scientists delivering AI-ready lakehouse architectures for ML experimentation and real-time streaming intelligence.
- Architected a streaming ingestion pipeline processing 50+ million GPS events daily to power ETA optimization, ranking enrichment, and ML model training, reducing training time by 40%.
- Provisioned secure ML infrastructure on SageMaker to support GenAI experimentation and NLP deep learning workloads.
- Implemented CI/CD automation, reducing deployment time by 70% across 20+ data pipelines.
- Designed cloud-native forecasting pipelines integrating POS, promotions, weather, and IoT sensor data from five global bottling factories across 1+ million SKUs.
- Engineered a delta lake bronze, silver, and gold medallion architecture in Databricks using PySpark, improving demand forecast accuracy by 22%.
- Built an IoT streaming ingestion pipeline (Azure IoT Hub, Spark Streaming, and Delta Lake), enabling predictive maintenance analytics and reducing unplanned downtime by 25%.
- Designed executive Power BI dashboards with row-level security and automated refresh cycles, and reduced manual reporting by 60%.
Data and AI Consultant
Deloitte
- Mentored four junior engineers on Data Vault 2.0 modeling and Snowflake best practices across a multi-region cloud migration program.
- Built a cloud-native dbt and Snowflake transformation framework with Azure DevOps CI/CD, cutting batch processing from seven hours to under two hours, delivering a71% reduction.
- Delivered a predictive maintenance platform, reducing equipment failure risk by 35% across upstream oil and gas operations.
- Ensured multi-region governance and 100% regulatory traceability with zero security escalations across HSE and SOX audits.
- Designed layered DBT architecture with snapshots, incremental models, and automated data quality tests.
Experience
End-to-end AI App Deployment on AWS | GPT-style Conversational App
https://mushirul-aman.vercel.appMultimodal RAG System
https://mushirul-aman.vercel.appLLM Fine-tuning Pipeline
https://mushirul-aman.vercel.appEducation
Bachelor's Degree in Computer Science Engineering
Vellore Institute of Technology (VIT) - Vellore, India
Certifications
Databricks Certified Data Engineer Professional
Databricks
GCP Professional Data Engineer
Google Cloud
AWS Certified Solutions Architect – Associate (SAA-C03)
Amazon Web Services (AWS)
Skills
Libraries/APIs
PySpark, REST APIs, PyTorch
Tools
BigQuery, Advertising Tools & Platforms, Apache Airflow, Amazon SageMaker, Microsoft Power BI, AWS IAM, Tableau, AWS Glue, Azure IoT Hub, Terraform, Flink, Cloud Dataflow, Amazon Athena, Amazon CloudWatch, Claude Code, Grafana, Composer
Languages
Snowflake, Python, SQL
Frameworks
Apache Spark, Spark, Spark Structured Streaming, Streamlit, AWS HA
Paradigms
ETL, Dimensional Modeling, B2B, Business Intelligence (BI), HIPAA Compliance, Azure DevOps, Automated Testing, Microservices
Platforms
Databricks, Amazon Web Services (AWS), Azure, Linux, AWS Lambda, Apache Kafka, AWS IoT, Google Cloud Platform (GCP), Docker, Azure Synapse, Cloud Run, Apache Flink, CrewAI, NVIDIA CUDA
Storage
Redshift, Databases, Data Lake Design, Data Pipelines, Amazon Aurora, PostgreSQL, Data Lakes, Amazon S3 (AWS S3), Elasticsearch, Redis
Other
Data Build Tool (dbt), CI/CD Pipelines, Security, SOX, Data Governance, Data Engineering, Data Modeling, Forward Deployed Engineering (FDE), AI Engineering, Data & AI Architect, Architecture, Data Architecture, Reverse Engineering, Solution Architecture, Data Analysis, Data Processing, Data Science, Data Cleaning, Data Analytics (Marketing), Data Orchestration, Amazon RDS, FinOps, Cloud, Cloud Services, Analytics, Dashboards, Google BigQuery, ELT, Generative Artificial Intelligence (GenAI), Retrieval-augmented Generation (RAG), MLflow, Amazon Kinesis, LangChain, Pinecone, Vector Search, LLM Agents, FastAPI, Machine Learning, LLM Fine-tuning, Customer Data Platform (CDP), Query Optimization, Reports, Dagster, Data Quality, Medallion Architecture, Metabase, Delta Lake, GitHub Actions, Pub/Sub, EMR, EC2, Databricks Workflows, Unity Catalog, Amazon Redshift, Cloud Composer, Cloud Storage, Dataproc, Schema Evolution, Async Processing, JWT/OAuth, Data Lineage, Data Analytics, Cloud Computing, Networking, Artificial Intelligence (AI), Amazon Bedrock AgentCore, AWS ECS Fargate, Infrastructure as Code (IaC), LoRa, qLora, Machine Learning Operations (MLOps), AI Model Training, Model Serving, Gemini
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring