Consultant online-learning-to-rank
2021 - 2022Lowe's Home Improvement- Implemented the analysis of potential improvements over the current setup with an Online Learning to Rank solution.
- Performed the ranking analysis of the performance of the current on-site search solution.
- Guided the development team on how to set up an OLTR system in their cloud infrastructure.
Technologies: Elasticsearch, Python, Architecture, Containerization, CI/CD Pipelines, APIs, Git, Python 3, Back-end, Unit Testing, Technical ConsultingMachine Learning Engineer
2018 - 2021DPG Media Nederland- Developed a real-time content-based classifier to recommend news articles to end users.
- Set up a monitoring infrastructure using Prometheus with proper integration into Kubernetes.
- Created batch jobs using Spark and managed those with Airflow.
Technologies: Apache Kafka, Python, Amazon Web Services (AWS), Continuous Deployment, Continuous Integration (CI), Kubernetes, Spark, Apache Airflow, Full-stack, Architecture, Web Development, Team Leadership, Databases, Containerization, CI/CD Pipelines, APIs, Django, REST, Git, Full-stack Development, REST APIs, Python 3, Pytest, Technical Leadership, Front-end, Scalability, Back-end, Flask, NoSQL, PostgreSQL, Big Data, Distributed Systems, SQL, Unit Testing, Agile, Microservices, Software Implementation, Software ArchitectureSoftware Engineer
2017 - 2018Integrated Digital Solutions- Developed a monitoring application for a Video on demand platform written in Python.
- Implemented log collection and monitoring using the ELK stack.
- Achieved a visualization dashboard with Angular backed by Elasticsearch.
Technologies: Python, Angular, ELK (Elastic Stack), Logstash, Filebeat, Elasticsearch, Full-stack, Architecture, Web Development, CI/CD Pipelines, Django, REST, Git, JavaScript, Amazon Web Services (AWS), Full-stack Development, REST APIs, Python 3, Pytest, Technical Leadership, Front-end, Back-end, Video on Demand (VOD), Over-the-top Content (OTT), Flask, Unit Testing, Agile, Microservices, Software ImplementationFull-Stack Engineer
2016 - 2017904Labs- Created a high-level application and infrastructure design.
- Automated infrastructure management using Ansible.
- Implemented the Docker-based CI deployment process.
- Set up a log collection (ELK stack) and application and performed infrastructure monitoring and alerting.
- Implemented techniques for Learning to Rank (LTR) described in the research papers.
- Created a customer dashboard using Flask, Angular, and Bootstrap.
Technologies: Angular, Bootstrap, Redis, Celery, Elasticsearch, VMware vSphere, Jenkins, Ansible, Docker, Python, JSON, Full-stack, Architecture, Web Development, Team Leadership, Databases, Containerization, CI/CD Pipelines, APIs, REST, Git, JavaScript, RabbitMQ, Full-stack Development, REST APIs, Python 2, Python 3, Pytest, Technical Leadership, Front-end, Scalability, SaaS, Back-end, MongoDB, CSS, Data Visualization, Flask, NoSQL, PostgreSQL, HTML, Distributed Systems, SQL, Unit Testing, Agile, Microservices, Software Implementation, Software ArchitectureFreelance Full-Stack Developer
2015 - 2015Open Studio- Wrote web crawlers/scrapers using Scrapy.
- Create a REST API using Flask.
- Created a dashboard to control and monitor web crawlers.
Technologies: SQL Server DBA, Bootstrap, Scrapy, Docker, Python, JSON, Web Development, Databases, Containerization, APIs, REST, Git, JavaScript, Full-stack Development, REST APIs, XML, Python 2, Pytest, Technical Leadership, Front-end, Back-end, CSS, PostgreSQL, Web Scraping, HTML, Vue, SQL, Unit Testing, Django REST Framework, Agile, Software ImplementationFull-Stack Developer
2015 - 2015Jikko.nl- Designed the infrastructure.
- Created a REST API for multiple microservices.
- Setup an ELK stack for log collection.
- Setup metric monitoring dashboard using Graphite and Grafana.
Technologies: Angular, Logstash, Apache, NGINX, Vagrant, Ansible, Docker, Grafana, Graphite, Kibana, Elasticsearch, Python, CouchDB, Redis, REST, JavaScript, Full-stack Development, REST APIs, Python 2, Pytest, Front-end, Back-end, CSS, Flask, MySQL, Web Scraping, HTML, Unit Testing, Agile, Software ImplementationData Engineer
2012 - 2014Ripe NCC- Implemented Lambda architecture using Hadoop stack.
- Created Hadoop jobs to compute aggregations in real-time and historical data.
- Managed a HBase/Hadoop/HDFS cluster of 150+ nodes using Ansible.
- Implemented and managed a workflow system for batch processing and incrementally updating datasets.
Technologies: Apache Pig, Bash, Python, Maven, Eclipse, Nagios, Java, Ansible, HBase, Hadoop, Databases, Git, RabbitMQ, REST APIs, Python 2, Pytest, Back-end, Data Visualization, Flask, NoSQL, Big Data, Distributed Systems, SQL, Unit Testing, Microservices, Software ImplementationJava Programmer
2006 - 2010Tools For Data- Implemented string matching algorithms and similarity metrics.
- Profiled multi-threaded algorithms implemented in Java.
- Created a Java Swing GUI design.
- Implemented a light-weight object relation mapping framework for an embedded database.
- Wrote unit tests in JUnit.
Technologies: Eclipse, Maven, Swing, Java, MySQL, SQL, Unit Testing, Software Implementation