Michiel Van der Lee, Developer in Fredericton, NB, Canada
Michiel is available for hire
Hire Michiel

Michiel Van der Lee

Verified Expert  in Engineering

Software Developer

Location
Fredericton, NB, Canada
Toptal Member Since
March 2, 2020

Michiel has years of experience working for both enterprise and startup clients delivering Rest APIs, Data Lakes, data analytics, and responsive UI. He designs architecture and code that follow industry best practices, is easily maintainable, thoroughly tested, and highly robust.

Portfolio

Change Dynamix, Inc.
Amazon Web Services (AWS), Elasticsearch, PostgreSQL, Apache Spark, Angular...
IBM Canada
Linux, Eclipse, JavaScript, Java

Experience

Availability

Part-time

Preferred Environment

Amazon Web Services (AWS), PostgreSQL, Docker, Visual Studio Code (VS Code), Linux, Windows

The most amazing...

...data processing pipeline I've developed had custom data with many aggregation pivots and Rest APIs for accessing the data.

Work Experience

Full-stack Development Team Lead

2017 - 2019
Change Dynamix, Inc.
  • Updated the web and API design and code from an ad hoc startup level to the enterprise level. This enabled our developers to increase productivity and provide stability and reliability to our customers.
  • Created a data pipeline to mutate incoming data, add geodata, and create aggregations.
  • Automated our AWS resource management via CloudFormation and Serverless.
  • Tracked and fixed bugs using Jira as a reporting tool.
  • Implemented numerous features, both back end, and front end.
Technologies: Amazon Web Services (AWS), Elasticsearch, PostgreSQL, Apache Spark, Angular, JavaScript, Python

Software Developer

2012 - 2017
IBM Canada
  • Created a task management framework with a Rest API and UI to schedule Java tasks for a specific process on a specific host. No existing tool fit our unique needs, so it was created from scratch. Many projects now use it.
  • Tracked and fixed bugs using IBM's internal tracking tool.
  • Created the ability to find and resolve object dependencies within the system. Due to the fast growth, the project had seen, this had become a nightmare to deal with, and deleting an object left many other objects broken. My task was to resolve this.
Technologies: Linux, Eclipse, JavaScript, Java

Distributed Task Management Platform

The product was comprised of distributed appliances with each appliance having multiple services. I was assigned an issue that required me to launch a task on particular services on all appliances, triggered by the master node. At the time, no existing solution existed that would work in our environment. I went ahead and designed a solution that could trigger a task for a particular service on a particular appliance, as well as track its status and cancel tasks. Before I finalized the implementation, several other teams were already using it successfully for their own needs.

Technical tools used: Java, PostgreSQL, Java Message Service (JMS), iptables.

Data Processing Pipeline And Data Lake

I joined this company when they were still in the POC stage and were collecting security-related data via a custom collector. They were storing this in Redshift and had a custom data pipeline for processing and storage. Due to this, and storage inefficiencies, this cost over $15,000/month with sub-par performance. Our custom processing was at least four hours behind and was consistently dropping or not enhancing the data. During my time there, I switched the pipeline to Apache Spark on EMR, and utilized AWS Athena with Redis for aggregated data. This allowed us to process the data live as it came in, and we never again fell behind. It also made the pipeline much more maintainable and easy to work with. The cost was brought down to about $3,000/month, resulting in significant savings.

DevOps

I set up a microservice architecture from development to production. I was responsible for setting up the standards and processes used by developers to deliver features from start to finish. Tasks included:
* Project structure
* Git structure
* Automated CI/CD
* E2E testing standards
* Deployment routing and authorization

Languages

HTML, CSS, Python, SQL, Bash, TypeScript, Java, JavaScript

Other

SSH, Full-stack

Frameworks

Flask, Apache Spark, Angular

Libraries/APIs

Flask-Marshmallow, REST APIs, Auth0 API

Tools

GitLab, GitHub, Git, Docker Compose, Amazon Athena, Amazon Elastic MapReduce (EMR), AWS Glue, AWS IAM, Amazon ElastiCache, Auth0

Paradigms

API Architecture, Agile Software Development

Platforms

Windows, Linux, Docker, Visual Studio Code (VS Code), Amazon Web Services (AWS), Eclipse, AWS Lambda, Amazon EC2

Storage

PostgreSQL, Redis, Relational Databases, MongoDB, Elasticsearch, Amazon S3 (AWS S3)

2011 - 2013

Diploma in IT Programming

Nova Scotia Community College - Middleton, Nova Scotia, Canada

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring