Michiel Van der Lee, Software Developer in Fredericton, NB, Canada
Michiel Van der Lee

Software Developer in Fredericton, NB, Canada

Member since December 10, 2019
Michiel has years of experience working for both enterprise and startup clients delivering Rest APIs, Data Lakes, data analytics, and responsive UI. He designs architecture and code that follow industry best practices, is easily maintainable, thoroughly tested, and highly robust.
Michiel is now available for hire

Portfolio

Experience

Location

Fredericton, NB, Canada

Availability

Part-time

Preferred Environment

Amazon Web Services (AWS), AWS, PostgreSQL, Docker, VS Code, Linux, Windows

The most amazing...

...data processing pipeline I've developed had custom data with many aggregation pivots and Rest APIs for accessing the data.

Employment

  • Full-stack Development Team Lead

    2017 - 2019
    Change Dynamix, Inc.
    • Updated the web and API design and code from an ad hoc startup level to the enterprise level. This enabled our developers to increase productivity and provide stability and reliability to our customers.
    • Created a data pipeline to mutate incoming data, add geodata, and create aggregations.
    • Automated our AWS resource management via CloudFormation and Serverless.
    • Tracked and fixed bugs using Jira as a reporting tool.
    • Implemented numerous features, both back end, and front end.
    Technologies: Amazon Web Services (AWS), Elasticsearch, AWS, PostgreSQL, Apache Spark, Angular, JavaScript, Python
  • Software Developer

    2012 - 2017
    IBM Canada
    • Created a task management framework with a Rest API and UI to schedule Java tasks for a specific process on a specific host. No existing tool fit our unique needs, so it was created from scratch. Many projects now use it.
    • Tracked and fixed bugs using IBM's internal tracking tool.
    • Created the ability to find and resolve object dependencies within the system. Due to the fast growth, the project had seen, this had become a nightmare to deal with, and deleting an object left many other objects broken. My task was to resolve this.
    Technologies: Linux, Eclipse, JavaScript, Java

Experience

  • Distributed Task Management Platform (Development)

    The product was comprised of distributed appliances with each appliance having multiple services. I was assigned an issue that required me to launch a task on particular services on all appliances, triggered by the master node. At the time, no existing solution existed that would work in our environment. I went ahead and designed a solution that could trigger a task for a particular service on a particular appliance, as well as track its status and cancel tasks. Before I finalized the implementation, several other teams were already using it successfully for their own needs.

    Technical tools used: Java, PostgreSQL, Java Message Service (JMS), iptables.

  • Data Processing Pipeline And Data Lake (Development)

    I joined this company when they were still in the POC stage and were collecting security-related data via a custom collector. They were storing this in Redshift and had a custom data pipeline for processing and storage. Due to this, and storage inefficiencies, this cost over $15,000/month with sub-par performance. Our custom processing was at least four hours behind and was consistently dropping or not enhancing the data. During my time there, I switched the pipeline to Apache Spark on EMR, and utilized AWS Athena with Redis for aggregated data. This allowed us to process the data live as it came in, and we never again fell behind. It also made the pipeline much more maintainable and easy to work with. The cost was brought down to about $3,000/month, resulting in significant savings.

  • DevOps (Development)

    I set up a microservice architecture from development to production. I was responsible for setting up the standards and processes used by developers to deliver features from start to finish. Tasks included:
    * Project structure
    * Git structure
    * Automated CI/CD
    * E2E testing standards
    * Deployment routing and authorization

Skills

  • Languages

    HTML, CSS, Python, SQL, Bash, TypeScript, Java, JavaScript
  • Other

    SSH, Full-stack, AWS
  • Frameworks

    Flask, Apache Spark, Angular, AWS EMR
  • Libraries/APIs

    Flask-Marshmallow, Auth0 API
  • Tools

    GitLab, GitHub, Git, VS Code, Docker Compose, AWS Athena, AWS Glue, AWS IAM, AWS ElastiCache, Auth0
  • Paradigms

    API Architecture, Agile Software Development
  • Platforms

    Windows, Linux, Docker, Amazon Web Services (AWS), Eclipse, AWS Lambda, AWS EC2
  • Storage

    PostgreSQL, Redis, MongoDB, Elasticsearch, AWS S3, AWS RDS

Education

  • Diploma in IT Programming
    2011 - 2013
    Nova Scotia Community College - Middleton, Nova Scotia, Canada

To view more profiles

Join Toptal
Share it with others