Rachit Mutreja
Verified Expert in Engineering
Software Developer
Kitchener, ON, Canada
Toptal member since June 27, 2024
Rachit is a senior back-end engineer with over a decade of experience building big data pipelines, microservices, and APIs. He is proficient in Java, Scala, and Python and is skilled in leveraging various AWS-managed and unmanaged services to build scalable and high-performance back-end systems. Rachit is excited to take on new challenges and new projects.
Portfolio
Experience
Availability
Preferred Environment
Linux, IntelliJ IDEA, GitHub, Slack, Spark, Java, Scala, Python 3
The most amazing...
...thing I've built is a re-usable all-in-1 scheduling system which took care of cluster management, and running Spark jobs on EMR.
Work Experience
Senior Software Developer
Nielsen
- Developed a data pipeline that processes millions of data points near real-time using Spark on Amazon Elastic MapReduce (EMR).
- Re-engineered an application build using microservices architecture to a modular monolith, reducing development, local testing, and deployment times.
- Managed the CI/CD pipelines and overlooked the deployment process.
Manager Projects
Cognizant
- Designed and implemented Spark jobs to create an organized data layer on top of a data lake based on Apache Hive containing common variables to be used across the organization.
- Created and delegated tasks to a team of four people based on their skill set, task priority, and risk.
- Ensured any technical or operational blockers faced by the team were addressed.
Senior Software Engineer
Optum
- Developed an on-premise data lake using the Hadoop ecosystem.
- Built an ingestion system using Sqoop and Spark to ingest data from various sources into the data lake.
- Automated the monitoring of the data ingestion process to reduce manual effort.
Senior Software Engineer
Impetus Technologies
- Worked closely with a team of data scientists working on merchant transaction data for American Express to identify anomalies.
- Developed an ETL process to push anomalous merchant data to Elasticsearch, which could be effectively indexed for better search capabilities like text search.
- Designed and implemented REST APIs using the Spring MVC framework to retrieve data indexed in Elasticsearch.
Senior Software Engineer
Ness Digital Engineering
- Developed a framework used by car dealers across the USA for building their websites and inventory management.
- Ensured that the websites published by dealers were compliant with Web Content Accessibility Guidelines (WCAG).
- Implemented a test-driven development (TDD) methodology within an Agile framework, utilizing the Rally Agile project management tool for efficient project planning and execution.
Associate Consultant
Oracle
- Customized and implemented FLEXCUBE, a core banking solution by Oracle, for over 10 clients.
- Built complex PL/SQL procedures to migrate data from various legacy banking systems to a database schema defined for Oracle FLEXCUBE.
- Generated insightful reports for clients using Oracle BI Publisher.
Experience
Data Pipeline for Processing Near Real-time Ad Measurement Data
Skills
Libraries/APIs
PySpark
Tools
IntelliJ IDEA, Slack, Amazon Elastic MapReduce (EMR), GitHub, Boto 3, Amazon Athena, AWS CloudFormation, AWS Glue, GitLab CI/CD, Apache Airflow, Apache Sqoop, Oracle BI Publisher
Languages
Scala, Java, Python 3, SQL
Frameworks
Spark, Hadoop, Yarn, Spring
Platforms
Amazon Web Services (AWS), AWS Lambda, Amazon EC2, Linux, Unix, MapR, Apache Pig, Oracle
Paradigms
Microservices, Functional Programming, Scrum, Agile, ETL
Storage
Amazon DynamoDB, Amazon S3 (AWS S3), HDFS, Elasticsearch, Apache Hive, MySQL, PL/SQL
Other
Troposphere, SA, RESTful Web Services, Unix Shell Scripting, Oracle WebLogic Application Server
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring