Staff Software Engineer2017 - PRESENTStripe
Technologies: Redis, Apache Kafka, Hadoop, Scalding, Spark, Python, Java, Scala
- Made the ML feature pipeline faster and more reliable which saved $3 million annually.
- Optimized a data pipeline's performance by 20x so a product can be launched on time.
- Rebuilt an online feature store based on a Redis cluster and Lua script that cuts latency from 100 milliseconds to 5 milliseconds (ms).
- Led a team to design/implement a multivariate experimentation service that can handle 3,000 QPS (queries per second) per node and a client-side p50 of 5 ms.
Senior Software Engineer2014 - 2017
Technologies: Python, Apache Pig, Apache Avro, Apache ZooKeeper, Apache Lucene, Apache Kafka, Java
- Implemented a serialization system which reduced the p50 latency by 30% and CPU usage by 15%, and achieved $2.5M annual saving.
- Mentored an intern to design and implement a prototype for facet search, and boosted exploratory search CTR by 15%.
- Migrated 80% of Linkedin's search traffic from a legacy search system to the new APIs.
Member of Technical Staff2013 - 2014Oracle
Technologies: OpenStack, Apache ZooKeeper, Java, C++
- Developed an OpenStack Neutron plugin for Oracle Virtual Network Controller.
- Built a UI to visualize and automate virtual network setup.
- Developed an API back end to interact with OpenStack and virtual machines.