Lead Software Engineer2017 - PRESENTScripbox
Technologies: Python, Airflow, Celery, RabbitMQ, Apache Spark, Django, React, AWS Redshift, PostgreSQL, MySQL, Sentry, Docker
- Developed an analysis tool from scratch using Python and Django with React.
- Implemented a workflow framework on top of Airflow.
- Developed entire data pipelines from scratch using Apache Airflow and Apache Spark.
- Integrated multiple upstream data sources into AWS Redshift.
- Implemented dashboards using Redash and Metabase.
- Managed the data engineering team.
- Mentored different teams on database-design-related issues.
Senior Software Engineer2016 - 2017JPMorgan Chase & Co.
Technologies: Python, Enaml, Athena, Kassandra, Flask, PostgreSQL
- Implemented a graphical user interface (GUI) with Python and Enaml for securities trading management.
- Implemented REST services for downstream application usage.
- Integrated multiple upstream services to get securities-related data in the bank.
- Migrated a part of the legacy application to a new framework from scratch.
- Improved unit test coverage from 60% to 95%.
Engineering Lead2015 - 2016Nearfox
- Designed and implemented a Nearfox product from scratch.
- Implemented the back end using Python and Django REST.
- Designed the admin panel for user management for the internal operations team.
- Maintained an AWS-based infrastructure.
- Implemented CI/CD with Jenkins.
- Deployed with Docker and Kubernetes.
- Mentored junior developers.
- Managed a team of four passionate engineers.
Co-founder | CTO2014 - 2016Indiallo.com
Technologies: Cordova, Ionic, Node.js, Python, Django, Scrapy, PostgreSQL, Docker, Kubernetes
- Developed a hybrid app using Cordova with Ionic.
- Implemented a back end with Python and Django.
- Crawled data heavily from multiple sources using Scrapy and custom crawlers.
- Managed product marketing.
- Implemented a large-scale data processing layer for data consistency.
- Implemented CI/CD with Kubernetes and Docker.
- Hired the engineers and marketing specialists.
- Managed the tech part of the product without any other help.
Senior Software Engineer2014 - 2015Bank of America
Technologies: Python, Flask, Quartz, Kassandra, Sybase, Netezza
- Implemented a desktop application using Python and Tkinter.
- Developed a framework for a position reconciliation process.
- Implemented a worker strategy to handle heavy volume of data input from multiple sources.
- Migrated ETL pipelines from Informatica tool to a Python-based Quartz infrastructure.
- Built the back-end API that can be accessed by downstream applications for data updations.
Software Developer2011 - 2014Google (Consultant from Ness Technologies India)
- Developed an internal tool for workflow management for Google Map Maker edits.
- Implemented complex algorithms to take a correct sampling of edits for routing.
- Created an internal dashboard for the higher management of map project insights.
- Built a people management system web application with Python and Django.
- Constructed data store in Google Dremel.
- Implemented a tool for auto-approving edits over Google Map Maker.
- Designed a data layer with multiple databases like MySQL, PostgreSQL, and Dremel.
- Implemented a caching layer with Java for reducing the load on the mainstream servers.