Senior Software Engineer
2016 - PRESENTLinkedIn- Designed and built a near real-time comment relevance system that powers all relevant comments on the LinkedIn feed. The system is based on a machine learning model and a Kafka and Samza based indexing and serving architecture that serves an audience of 500 million people.
- Led a team of 5 engineers and filed a patent for the system.
- Restructured an internal query language for querying FollowFeed (the LinkedIn feed system). The restructured query language supports all LinkedIn feed traffic across 130+ use cases on the website and supports over 500 million queries a day.
- Hosted information sharing sessions, tech talks, and mentored junior engineers in their individual roles.
Technologies: Java, Python, Bash, RocksDB, Kafka, Samza, Rest.li, Avro, HDFS, Lucene, JUnit, TestNG, GradleSoftware Engineer
2011 - 2016Google- Built collaborative filtering systems that process > 1 billion requests a day in the critical path of Google's search and mobile experiences.
- Developed near real-time Twitter recommendations surfaced for news-like queries in searches: 1 billion+ requests per day in the critical request path for Google search. (low latency, high availability, globally distributed indexing and serving).
- Shared offline infrastructure for location data (~ petabytes of data); signal to location based predictions on several Google systems (Search, Android: Google Now).
- Evaluated and reviewed infrastructure for recommendation relevance (used internally by 30+ teams).
- Unified Google's look and feel across properties with a common infrastructure with 2 UI refreshes.
- Made back-end endpoints for product access customization on all Google properties (100+ products).
- Built the UI and infrastructure features around authentication (used by 1 billion+ users); helped onboard 10+ new products.
Technologies: Distributed Systems, MapReduce, Collaborative Filtering, Recommendation Systems, C++, Java, Python, Protocol Buffers, Linux, SQL, NoSQL, HTML, CSS, JavaScript, GTest, GCC, C++11Chief Technical Architect
2009 - 2011Zigndog- Managed and defined client requirements, production deadlines, code quality, and the complete architecture of the solution delivered by the company.
- Provided timely and highly technical in-depth advice and generated new clients.
- Set up the complete tech stack for the company.
- Executed on 20+ projects including name brand clients IIM Kozhikode, Hindustan Times, and more.
Technologies: Python, Django, HTML, CSS, JavaScript, PHPEngineering Intern
2010 - 2010Qualcomm- Was selected as one of the 4 interns from India to work on projects at Qualcomm headquarters at San Diego as part of the Qualcomm Technology and Innovators Program.
- Worked on a low-power PAN/BAN chip as part of the corporate R&D group.
Technologies: Python, Aardvark, Bluetooth, pytest, NoseSoftware Development Engineer (Intern)
2009 - 2009Microsoft- Worked on the BizTalk Server Developer Tools team.
- Implemented a novel, stateless coalescing algorithm on the .NET TreeView Control to implement a feature proposed by Robertson et al. in their HCI Paper.
- Implemented the visualization of mappings between schemas for the Conference on Human Factors in Computing Systems, ACM SIGCHI.
Technologies: C#, Biztalk, XML, XSLT, .NET
Divye Kapoor
Algorithms Developer in Sunnyvale, CA, United States
Member since April 15, 2017
Divye is a very strong, in the top 0.1%, infrastructure engineer with working experience at Google and LinkedIn. He has a Master of Technology in computer science from the Indian Institute of Technology where he was also a silver medalist and the computer science branch valedictorian.
Divye is now available for hire
Experience
- C++, 19 years
- Linux, 16 years
- Algorithms, 12 years
- Systems Engineering, 7 years
- Large Scale Distributed Systems, 7 years
- Infrastructure Architecture, 6 years
- High Availability, 5 years
- Machine Learning, 2 years
Availability
Part-time
Preferred Environment
Vim, IntelliJ, PyCharm
The most amazing...
...thing I've built is a recommendation system for Twitter results on the Google search results page. It triggers for all news-like queries to Google.
Employment
Experience
- Smartphone-Based Indoor Tracking Using Magnetic and Indoor Maps (Other amazing things)http://dx.doi.org/10.1109/ISSNIP.2015.7106948
An IEEE Peer Reviewed Research Publication in ISSNIP 2015.
The paper describes a smartphone-based indoor tracking system based on the ideas of inertial navigation and localized magnetic field sampling.
Skills
Languages
C++, Java, JavaScript, Python 3, CSS, Bash, Less, Python, HTMLFrameworks
Google Protocol Buffer, Django, .NET, BoostLibraries/APIs
Standard Template Library (STL)Paradigms
MapReduce, Template MetaprogrammingPlatforms
Linux, Apache Kafka, Amazon Web Services (AWS), Android, Celery eCommerceOther
Algorithms, Recommendation Systems, Large Scale Distributed Systems, Infrastructure Architecture, Network Programming, RPC, Scalability, Data Structures, High Availability, Protocol Buffers, Systems Engineering, Infrastructure, Distributed Systems, Google, TCP, SSL, SSH, TCP/IP, Machine Learning, GunicornTools
Vim Text Editor, Git, Subversion (SVN), Nginx, Emacs, RRDtool, GradleStorage
MySQL, PostgreSQL, JSON, Redis
Education
- Bachelor of Technology in Computer Science and Engineering2006 - 2011Indian Institute of Technology - Roorkee, India
- Master of Technology in Computer Science and Engineering2006 - 2011Indian Institute of Technology - Roorkee, India
