Senior Software Engineer
2022 - PRESENTBroad Institute- Chosen as a core back-end developer for a highly critical project for the org. Ramped up in under a month on an extremely complex Scala service.
- Made essential changes to the back end to support Azure as a new cloud offering for our https://terra.bio platform.
- Acted as the thought leader on observability, monitoring, and error detection.
- Pushed the org to use consumer-driven contract testing to replace some of our annoying integration tests.
Technologies: Scala, Python 3, JavaScript, React, Google Cloud Platform (GCP), Azure, Java, REST APIs, OAuth 2, Node.js, Distributed Systems, Docker, Bash, MySQL, CircleCI, Kubernetes, Python, PostgreSQL, Terraform, Microservices, Jira, Redis, Full-stack, Data Analysis, API Integration, Linux, DevOps, Reverse Engineering, APIs, Algorithms, Documentation, Automation, Technical Architecture, Architecture, Technical Design, Microservices Architecture, Application Architecture, System Architecture, Back-end, System Architecture Design, Full-stack Development, Web Forms, Unit Testing, Integration Testing, HTML, Business to Business (B2B), Tables, User Experience (UX), OptimizationSenior Software Engineer
2020 - 2022Known Global- Designed and implemented a pipeline for ingesting hundreds of millions of data points from S3 into Snowflake, including monitoring and alerting via Datadog.
- Led a multi-month effort to productionalize a highly-complex linear TV ad shuffling algorithm written in Python by our data scientists.
- Planned and implemented a POC that led to the closing of a massive multi-million dollar contract with a large bank.
- Created and led team processes like retro, design reviews, sprint planning, and postmortems.
- Evangelized Snowflake as an analytics database and got the organization to adopt it for multiple separate projects.
Technologies: Python, PostgreSQL, Amazon Web Services (AWS), Google Cloud Platform (GCP), Kubernetes, Terraform, TypeScript, Vue, Datadog, Snowflake, SQLAlchemy, GitHub, CircleCI, MacOS, Python 3, JavaScript, REST APIs, OAuth 2, Node.js, Data Engineering, Distributed Systems, Docker, Bash, NoSQL, Microservices, Pytest, Jira, Redis, Web Scraping, Full-stack, Data Analysis, API Integration, Linux, NumPy, Pandas, DevOps, Reverse Engineering, APIs, Algorithms, Documentation, Automation, Videos, Technical Architecture, Architecture, Technical Design, Auth0, Auth0 API, Microservices Architecture, Application Architecture, System Architecture, Back-end, System Architecture Design, Full-stack Development, Data Visualization, Web Forms, AWS Lambda, Amazon S3 (AWS S3), Amazon CloudWatch, Unit Testing, Integration Testing, Amazon Route 53, HTML, Business to Business (B2B), Charts, Tables, User Experience (UX), OptimizationSenior Software Engineer
2018 - 2020Indigo- Designed and implemented a data model for our production data warehouse in Snowflake, used daily by our team of over a hundred data scientists.
- Delivered a multi-month project with very tight deadlines and shifting business requirements, centered around correctly reporting the contracted acres for that season.
- Led design and implementation on an enterprise service bus (ESB) using a Confluent-hosted Kafka endpoint and Scala microservices.
- Interviewed dozens of senior and principal back-end engineering candidates.
Technologies: Python, SQL, Snowflake, Amazon Web Services (AWS), Scala, Apache Kafka, TypeScript, React, MacOS, Python 3, GitHub, Datadog, Kubernetes, JavaScript, GraphQL, REST APIs, OAuth 2, Node.js, Data Engineering, Apache Avro, Distributed Systems, Docker, Bash, PostgreSQL, SQLAlchemy, CircleCI, Microservices, Pytest, Jira, Redis, Full-stack, Data Analysis, API Integration, Linux, NumPy, Pandas, DevOps, Mobile Apps, Reverse Engineering, APIs, Algorithms, Documentation, Automation, Streaming, Technical Architecture, Architecture, Technical Design, Auth0, Auth0 API, Microservices Architecture, Application Architecture, System Architecture, Back-end, System Architecture Design, Full-stack Development, Data Visualization, Web Forms, Minimum Viable Product (MVP), Amazon API Gateway, AWS Lambda, Amazon S3 (AWS S3), Amazon CloudWatch, Unit Testing, Integration Testing, Amazon Route 53, HTML, Business to Business (B2B), Charts, Tables, User Experience (UX), OptimizationSoftware Engineer II
2017 - 2018Localytics- Headed, planned, designed, and implemented our GDPR compliance effort. Delivered the new microservice and right-to-be forgotten mechanism on time and with no added computational or monetary cost to the system.
- Led an effort to change over our push messaging API calls from SNS to Google and Apple APIs. The successful implementation led to a tenfold increase in output of our push messaging services and significant cost savings from switching off SNS.
- Deleted thousands of lines of Scala code quickly and effectively from a business-critical system, processing tens of thousands of requests per second without any unintended side effects.
- Participated in the team on-call schedule and addressed production issues as they came up.
Technologies: Scala, Amazon Web Services (AWS), Terraform, SQL, Snowflake, MySQL, Amazon DynamoDB, NoSQL, MacOS, Python 3, GitHub, Kubernetes, Java, REST APIs, OAuth 2, Node.js, Data Engineering, Distributed Systems, Docker, Bash, Supercomputers, PostgreSQL, Microservices, Jira, Redis, Web Scraping, Full-stack, Data Analysis, API Integration, Linux, DevOps, Mobile Apps, Reverse Engineering, APIs, Algorithms, Documentation, Automation, Streaming, Technical Architecture, Architecture, Technical Design, Microservices Architecture, Application Architecture, System Architecture, Back-end, System Architecture Design, Data Visualization, AWS Lambda, Amazon S3 (AWS S3), AWS Elastic Beanstalk, Amazon CloudWatch, Unit Testing, Integration Testing, Amazon Route 53, HTML, Business to Business (B2B), Charts, Tables, OptimizationSoftware Engineer
2016 - 2017Thermo Fisher Scientific- Developed an internal web app to help visualize and design cancer diagnosis panels.
- Wrote a variant call format (VCF) file parser in Haskell.
- Collaborated with laboratory technicians and built a workflow and UI to help them automate their tasks.
Technologies: Python, Amazon Web Services (AWS), MacOS, Python 3, GitHub, REST APIs, Docker, Bash, Microservices, Pytest, Jira, Full-stack, Data Analysis, API Integration, Linux, NumPy, Pandas, APIs, Algorithms, Documentation, Automation, Django, Back-end, Data Visualization, Minimum Viable Product (MVP), Amazon API Gateway, AWS Lambda, Amazon S3 (AWS S3), AWS Elastic Beanstalk, Amazon CloudWatch, Unit Testing, Integration Testing, HTML, Business to Business (B2B), Charts, Tables, OptimizationResearch Assistant
2016 - 2016Michigan Medicine University of Michigan- Developed a multi-step Python pipeline to process MRI images on a supercomputer.
- Automated processing of clinical data for use in academic research.
- Oversaw data-security measures for the research lab.
Technologies: Python, Bash, MacOS, Python 3, GitHub, MATLAB, Docker, Full-stack, Data Analysis, Linux, NumPy, Pandas, Algorithms, Documentation, Automation, Django, Back-end, Data Visualization, Unit Testing, HTML, Charts, Tables, Optimization