Jack Kwok
Verified Expert in Engineering
Deep Learning Developer
San Francisco, CA, United States
Toptal member since May 23, 2019
With 20 years of experience, Jack excels at developing complex software systems and custom deep learning models for computer vision and natural language processing. He specializes in solving complex problems like 2D and 3D object detection, multi-object tracking, instance segmentation, and document understanding and classification. Jack has trained cutting-edge computer vision models for healthcare and autonomous driving problems, and he now focuses on LLM and generative AI.
Portfolio
Experience
- Deep Learning - 5 years
- Machine Learning - 5 years
- Computer Vision - 4 years
- PyTorch - 4 years
- Object Detection - 3 years
- Agentic RAG Systems - 2 years
- Object Tracking - 2 years
- Natural Language Processing (NLP) - 1 year
Preferred Environment
Amazon SageMaker, Google Cloud ML, Amazon Web Services (AWS), Scikit-learn, Windows, Linux, PyTorch, Python
The most amazing...
...project I have worked on involved building the first FDA-approved deep learning system for detecting dental diseases from X-rays.
Work Experience
Senior Staff Machine Learning Engineer
Udemy
- Served as the machine learning lead for the Udemy AI Assistant, a personalized AI tutor supporting 200,000+ Udemy courses.
- Partnered closely with the product manager to define milestones, priorities, and metrics.
- Evangelized emerging agentic AI applications in teaching and learning products.
- Led an agentic AI project for personalization of learners' learning paths based on learners' skill levels, along with personal and organizational learning goals.
Senior Machine Learning Scientist | Tech Lead
Overjet
- Developed state-of-the-art PyTorch computer vision models for automated clinical diagnosis and anatomical identification from dental radiographs.
- Built natural language processing (NLP) and visual document understanding (VDU) models for insurance document classification and clinical narrative comprehension.
- Created a scalable image processing inference pipeline on the Google Cloud Platform using Cloud Functions, Cloud Run, and Google Kubernetes Engine (GKE).
Staff Software Engineer | Computer Vision and Machine Learning
Lyft
- Applied deep learning and computer vision algorithms to solve autonomous driving problems.
- Led the design and development of custom deep learning-based multi-object trackers used by multiple teams to track cars, cyclists, pedestrians, and traffic control elements.
- Designed the initial production release of the active learning data pipeline for continuous machine learning model improvement.
Artificial Intelligence Fellow
Insight Data Science
- Developed a Computer Vision system based on a convolutional neural network that automatically annotates post-hurricane flooded roads on satellite imagery.
- Developed an open-source project on GitHub.
- Researched and published a blog post about the use of deep learning for disaster recovery.
Staff Software Engineer
- Built LinkedIn's video sharing platform from scratch.
- Wrote a technical blog post on building a Native video player library for Android.
- Mentored senior engineers on my team and set coding standards.
Software Architect
Trulia
- Scaled our mobile platform to over a dozen apps across iOS, and Android. This grew the audience over ten times. Trulia mobile apps are top-rated by users, and frequently selected for prestigious editorial features by Apple, Google Android (Editors' Choice, and Staff Pick), Amazon, and Samsung.
- Developed and built projects for iOS and Android involving geofencing and geospatial data, user data synchronization, cross-platform communication, and natural language processing.
Technical Leader
Cisco
- Led the architectural designs of Cisco Jabber (an enterprise VoIP app) on Android. Worked with product managers to translate business needs into technical specifications. Worked with cross-functional teams to define requirements, interfaces, and implementation approaches, and led a group of six talented Android developers to build out layered components of the application from scratch.
- Extended the Blackberry client with innovative voice features, coordinated development activities, and mentored junior engineers.
Senior Software Engineer
Weathernews Americas
- Developed the prototype, architecture, design, and implementation of Weathernews LiveLocal. LiveLocal is the US’s first streaming video application bringing videos from local broadcast TV stations to cell phones.
Experience
Deep Learning for Disaster Recovery
https://github.com/jackkwok/neural-road-inspectorFor details, see the blog post:
https://blog.insightdatascience.com/deep-learning-for-disaster-recovery-45c8cd174d7a
Education
Master of Engineering Degree in Computer Science
Massachusetts Institute of Technology - Cambridge, MA, USA
Bachelor of Science Degree in Computer Science
Massachusetts Institute of Technology - Cambridge, MA, USA
Bachelor of Science Degree in Mathematics
Massachusetts Institute of Technology - Cambridge, MA, USA
Certifications
Claude Certified Architect - Foundations
Anthropic
AWS Certified Machine Learning Engineer - Associate
Amazon Web Services
Google Cloud Platform Professional Machine Learning Engineer
Skills
Libraries/APIs
PyTorch, OpenCV, Scikit-learn, NumPy, Pandas, Keras, SciPy, REST APIs
Tools
Scikit-image, Amazon SageMaker
Languages
Python, Java
Frameworks
LangGraph
Platforms
Google Cloud Platform (GCP), Linux, Windows, Mobile, Android, iOS, Amazon Web Services (AWS), Kubernetes
Other
Computer Vision Algorithms, Deep Learning, Computer Vision, Linear Algebra, Object Detection, Object Tracking, Convolutional Neural Networks (CNNs), Image Processing, Machine Learning, Natural Language Processing (NLP), Generative Pre-trained Transformers (GPT), Computer Science, Artificial Intelligence (AI), RAG Architecture, Agentic AI, LLM Reasoning, Agentic RAG Systems, OpenAI SDK, Devices, Google Cloud ML, Video Codecs, Mobile Apps, MLflow, Gemini API, Videos, 3D Math, Geometry
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring