Ariel Kwiatkowski, Developer in Paris, France
Ariel is available for hire
Hire Ariel

Ariel Kwiatkowski

Verified Expert  in Engineering

Bio

Ariel is an experienced developer with a strong focus on machine learning algorithms for reinforcement learning, graph analytics, image classification, and feature engineering. His physics background makes math-heavy topics a core strength, along with hands-on experience with machine learning and software engineering. Ariel has obtained his PhD in the application of AI to crowd simulation.

Portfolio

AI Redefined
Python, Artificial Intelligence (AI), Machine Learning, Reinforcement Learning...
Institut Polytechnique de Paris
Artificial Intelligence (AI), Python, Reinforcement Learning, Machine Learning...
Bitville Oy
JavaScript, Flask, PyCharm, PyTorch, Python, Artificial Intelligence (AI)...

Experience

  • Python - 7 years
  • Machine Learning - 5 years
  • LaTeX - 4 years
  • Data Science - 3 years
  • TensorFlow - 3 years
  • Pandas - 2 years
  • PyTorch - 2 years
  • Flask - 1 year

Availability

Part-time

Preferred Environment

GitHub, PyCharm, Windows, Linux, Automation

The most amazing...

...code I've written was the RL training setup for my thesis. It enabled rich customization for research purposes and multi-agent training with the PPO algorithm.

Work Experience

Senior AI Researcher

2023 - PRESENT
AI Redefined
  • Developed Cogment Lab, an easy-to-use framework for human-in-the-loop AI research and development.
  • Created an AI assistant to manage a simulated high-energy grid for a big client.
  • Built a system for the rail network management via voice control, using Whisper and LLMs.
Technologies: Python, Artificial Intelligence (AI), Machine Learning, Reinforcement Learning, OpenAI, OpenAI Assistants API, Large Language Models (LLMs), AI Agents, AI-generated Code, ChatGPT, JavaScript

Early Stage Researcher

2020 - 2023
Institut Polytechnique de Paris
  • Wrote and published three peer-reviewed papers in international journals and conferences.
  • Created a flexible RL library used for multi-agent crowd simulation using Python and PyTorch.
  • Created a crowd simulation platform using the Unity game engine.
Technologies: Artificial Intelligence (AI), Python, Reinforcement Learning, Machine Learning, Technical Writing, Deep Reinforcement Learning, CSV File Processing, AI-generated Code

Research Assistant

2019 - 2020
Bitville Oy
  • Built a multi-agent reinforcement learning environment in Pycolab.
  • Implemented a distributed training procedure that involved training with old versions of the agent to improve ad-hoc cooperation in RLlib using TensorFlow.
  • Reimplemented the above in PyTorch, plus a theory of mind learning component.
  • Implemented PPO in PyTorch from scratch, with support for multi-agent environments and recurrent policies.
  • Contributed to the research design by finding theoretical predictions of experiment results.
Technologies: JavaScript, Flask, PyCharm, PyTorch, Python, Artificial Intelligence (AI), Machine Learning, Deep Reinforcement Learning, AI-generated Code

Machine Learning Engineer

2018 - 2018
Worklytics
  • Developed a machine learning-based employee retention prediction algorithm based on employees' activities, including an interpretation of the model's predictions and estimating the model's certainty about its predictions.
  • Performed exploratory data analysis on employee retention data.
  • Explored the possibility of detecting employee positions via clustering.
Technologies: Pandas, Scikit-learn, Google Cloud Platform (GCP), Python, Artificial Intelligence (AI), Machine Learning, Automation

Data Scientist I

2017 - 2017
CodiLime
  • Implemented a feature engineering scheme to improve a network analysis-related machine learning project.
  • Created a tutorial on optimization in TensorFlow.
  • Coordinated with coworkers and managers to adapt results from research papers to our automated ML system.
Technologies: Scikit-learn, Pandas, TensorFlow, Python, Artificial Intelligence (AI), Machine Learning

Deep Learning Intern

2016 - 2016
SeerIT
  • Implemented computer vision algorithms to detect electric insulation on images.
  • Implemented a neural network for end-to-end image segmentation.
Technologies: Keras, TensorFlow, Python, Artificial Intelligence (AI), Machine Learning, Convolutional Neural Networks (CNNs), Computer Vision, Image Recognition

Experience

ACORES

https://github.com/RedTachyon/temperature-analysis
A research project I participated in, which concluded in my Bachelor's thesis. It involved building a web app to speed up manual data labeling and building a machine learning model to detect anomalies in the signal.

NodeBook

https://github.com/RedTachyon/nodebook-prototype
Built the back end of a service for teachers to analyze the class dynamics via sociometric research. Part of a project for the Business Development Lab at KTH.

Festival Simulation

https://github.com/RedTachyon/festival_project
This was the final project for distributed artificial intelligence and intelligent agents at KTH. It's a simulation of human behavior at a festival, using agent-based modeling and reinforcement learning.

ACORES Label Helper

https://github.com/RedTachyon/label-helper
A web app built with Node.js and Express to assist with the data analysis for my Bachelor's thesis. It displays a graph of a time series and records the user's mouse clicks, saving them to a file and allowing for efficient manual labeling of large datasets.

Education

2020 - 2023

PhD in Computer Science

École Polytechnique - Paris, France

2019 - 2020

Master's Degree in Artificial Intelligence and Robotics

Aalto University - Helsinki, Finland

2018 - 2020

Double Master's Degree (KTH, Aalto) in ICT Innovation

EIT Digital - Finland and Sweden

2018 - 2019

Master's Degree in ICT Innovation, Autonomous Systems

KTH Royal Institute of Technology - Stockholm, Sweden

2015 - 2018

Bachelor's Degree in Physics, (individual studies)

Universtiy of Warsaw - Warsaw, Poland

Certifications

JUNE 2020 - PRESENT

Natural Language Processing Nanodegree

Udacity

MAY 2020 - PRESENT

Deep Reinforcement Learning Nanodegree

Udacity

FEBRUARY 2018 - PRESENT

Deep Learning Specialization

Coursera

Skills

Libraries/APIs

TensorFlow, OpenAI Assistants API, Keras, PyTorch, Pandas, NumPy, Scikit-learn, Node.js, OpenCV

Tools

ChatGPT, PyCharm, LaTeX, GitHub

Languages

Python, SQL, C++, JavaScript

Paradigms

Automation, Agile

Frameworks

Flask

Platforms

Google Cloud Platform (GCP), Linux, Windows

Storage

SQLite

Other

Data Science, Natural Language Processing (NLP), Deep Reinforcement Learning, Machine Learning, Artificial Intelligence (AI), Generative Pre-trained Transformers (GPT), Convolutional Neural Networks (CNNs), Computer Vision, Image Recognition, OpenAI, Large Language Models (LLMs), AI Agents, AI-generated Code, CSV File Processing, Reinforcement Learning, Robot Operating System (ROS), Research, Technical Writing

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring