Senior Software Developer
2021 - 2021Open Bean- Developed raw data ingestion using Scala, AWS S3, and Lambda.
- Designed raw data format that is versatile enough for required use-cases.
- Architected index data structure and library to speed up relevant queries and support downstream distributed computations.
Technologies: Scala, Amazon S3 (AWS S3), AWS Lambda, Akka Streams, Akka, Kubernetes, Amazon Simple Queue Service (SQS), AWS EMR, SBT, Apache Spark, Spark SQLSenior Software Developer
2020 - 2020Second Foundation- Developed a real-time market trading adapter for normalizing market operations for multiple use-cases.
- Participated in internal system design and protocols between distributed components.
- Developed a system for scraping of published data on various web pages.
Technologies: Kotlin, Coroutines, PostgreSQL, RabbitMQ, Solace, JVM, Trading Systems, Distributed SystemsSenior Software Developer
2017 - 2020Jumpshot- Served as the lead developer of the processing pipeline for internal platforms that were used throughout the company.
- Implemented a custom Spark job scheduling service for continuous application of patterns to data. This allowed for scaling out the computation to keep strict delivery deadlines.
- Implemented a safe mechanism of mutable data publication on HDFS using snapshotting. This prevented consumer errors and allowed for safe synchronization between clusters.
- Optimized recalculation algorithms to speed-up the computation by the order.
- Vastly improved service reliability, resiliency, and monitoring.
- Completely redesigned the pipeline for processing search engine results, improved source code, and participated in improving data quality.
- Occasionally led a few other developers on associated tasks.
Technologies: Apache Spark, Scala, Akka Actors, Concurrency, MongoDB, HDFS, PythonTechnical Lead
2012 - 2016ZOOM International- Implemented live screen monitoring into existing screen monitoring solutions.
- Developed integrations with an external system for call recording.
- Participated in complex bug fixing of business-critical applications.
Technologies: Java, JVM, Multithreading, Linux, Python, Bash