Aman Kaushik
Verified Expert in Engineering
Full Stack Developer
Seattle, WA, United States
Toptal member since November 17, 2020
Aman has four years of experience in the software development industry. He has designed, built, and optimized big data pipelines, REST APIs, web applications, and SPAs and has held development ownership. His career highlights include building an ETL pipeline from scratch, reducing processing time by 62%, reducing infrastructure cost by 26%, and increasing error rates by 73% while also holding back-end development ownership.
Portfolio
Experience
- Amazon Web Services (AWS) - 5 years
- Python 3 - 5 years
- PostgreSQL - 5 years
- Django REST Framework - 5 years
- Git - 5 years
- Django - 5 years
- JavaScript - 3 years
- Vue 2 - 3 years
Availability
Preferred Environment
Jira, Slack, Shell, Bash, Vim Text Editor, WebStorm, PyCharm, GitHub, Git
The most amazing...
...app I've made is a SPA that automates the grading process for student projects involving GitHub and Taiga board analysis, used at the Arizona State University.
Work Experience
Software Development Engineer
Amazon.com
- Developed an employee "Eligibility" vending service for a larger system, scaling to a total of 300,000 users with a 100,000 DAU, maintaining a less than 50ms latency for all calls.
- Built a "Seasonal Conversion Process" within the existing system. Worked with multiple stakeholders across multiple teams and multiple job verticals to deliver this project end-to-end in less than 3 months.
- Created a two-way data flow with the labor planning system using Amazon API Gateway and AWS Lambda. This integration supported continuous traffic of 20 TPS with bursts up to 120.
Software Development Engineer Intern
Amazon.com
- Held the complete ownership of a POC project to use S3-based triggering for big data jobs. Contributed to the big data platform Horizon in the finance tech department.
- Designed and developed the serverless architecture to take SNS and S3 events as input, extracted auxiliary data from DynamoDB, and then integrated the output using SQS with the existing code and infrastructure.
- Set up the proprietary framework for continuous integration and deployment to AWS infrastructure. Conducted unit testing using ScalaMock and AWS SAM.
Software Development Engineer
Fractal Analytics, Inc.
- Collaborated within the back-end engineering team on developing our cloud-based product, Trial Run. Held the complete ownership for the back-end of the customer-level experimentation module.
- Set up an ETL pipeline using PySpark, Airflow, and AWS to handle terabytes of data. Using LSH for approximate NN distance allowed us to decrease the processing time by 62% and infrastructure cost by 26% compared to the existing pipeline.
- Re-architectured API level code using Celery, RabbitMQ, and Redis caching to handle a 95x increase in experiment data size.
- Modified the data models, making the architecture more flexible to accommodate different data feeds from the clients.
- Reduced the data-error rate by 73% by setting up an automated QC process before and after the ETL process, also eliminating any manual intervention required.
- Set up a fully automated, modular deployment pipeline consisted of unit testing, post-release sanity checks, code quality assurance, artifact building and storing, and deployment to internal and cloud servers.
Software Development Engineer
S&P Global Market Intelligence
- Collected and delivered financial data feeds to clients within the Xpressfeed team. Xpressfeed is S&P's powerful data feed management solution that delivers data directly into the client's workflow.
- Implemented SQL Server long-running data jobs to process the daily market index data feed, collaborating with the index ingestion team.
- Collaborated within the index ingestion team to implement SQL jobs replicating data to the shared data layer that enables sharing the market index data across the organization.
Experience
OpenDoor Event Demo for ASU
http://asu-opendoor.firebaseapp.com/GTAnalyzer Web Application
https://gtanalyzer.firebaseapp.com/MindSumo Challenge | CapitalOne | Yelp Fusion API
Education
Master's Degree in Software Engineering
Arizona State University - Tempe, AZ
Bachelor's Degree in Information Technology
Jaypee Institute of Information Technology - India
Certifications
Introduction to Apache Spark
edX, Inc.
Big Data Analysis with Apache Spark
edX, Inc.
Distributed Machine Learning with Apache Spark
edX, Inc.
Skills
Libraries/APIs
Django ORM, Vue 2, Vuex, PySpark, GitHub API, Spark ML, Jenkins Pipeline, Stanford NLP, React
Tools
Amazon Simple Notification Service (SNS), Amazon Elastic Block Store (EBS), Amazon Elastic MapReduce (EMR), GitHub, Bitbucket, Git, PyCharm, Vim Text Editor, Shell, Slack, Amazon Simple Queue Service (SQS), AWS CloudFormation, Amazon Virtual Private Cloud (VPC), Spark SQL, GitLab, Gradle, CircleCI, Travis CI, Docker Hub, Docker Swarm, RabbitMQ, Celery, Amazon CloudWatch, Vue CLI, Jenkins, Jira, WebStorm, Apache Airflow
Languages
Python 3, Python 2, JavaScript, SQL, Bash, Bash Script, C++, Java, Scala
Frameworks
Django, Django REST Framework, Apache Spark, Vuetify
Paradigms
REST
Platforms
AWS Lambda, Amazon Web Services (AWS), Docker, Firebase, Heroku, Apache Kafka, Oracle
Storage
Amazon S3 (AWS S3), PostgreSQL, MySQL, SQLite, JSON, Amazon Aurora, Amazon DynamoDB, Redis, SQL Server 2012
Other
AWS Auto Scaling, Vue Router, APIs, Amazon Route 53, Firebase Hosting, Natural Language Processing (NLP), Web Scraping, Fuzzy Logic, Generative Pre-trained Transformers (GPT), Amazon API Gateway
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring