Jordi is available for hire

Jordi Llonch

Verified Expert in Engineering

Python Developer

Melbourne, Victoria, Australia

Toptal member since April 4, 2014

Expertise

Back-end CTO Data Scraping Data Engineering Web Scraping Distributed Systems Technical Leadership Automated Trading Software FastAPI Robotic Process Automation (RPA)MacOS Automation SQL Linux MySQL

Bio

A developer since 1992, Jordi has created projects for multiple sectors: leading multinationals, academia, and government bodies. He has led and scaled technical teams focussing on product stability, performance, and connecting descriptive requirements and acceptance tests using plain language. Jordi has developed high-performance, distributed projects, security, data processing, and automation. He has also contributed to open-source projects: Elasticsearch, Chef, GitLab, and others.

Portfolio

Gartner

Relational Databases, Data Modeling, Go, PHP, Amazon DynamoDB, Amazon Aurora...

World’s Leading Manufacturer of Construction and Mining Equipment

Azure Search, Azure, Microservices Architecture, Microservices, Architecture...

Leading Multinational Professional Services (under NDA)

Robotic Process Automation (RPA), Amazon Web Services (AWS), Redis, Terraform...

Experience

SQL - 20 years Linux - 20 years Python - 20 years APIs - 20 years Elasticsearch - 12 years Go - 10 years Web Scraping - 10 years Docker - 5 years

Availability

Full-time

Preferred Environment

Cloud, Cucumber, Kubernetes, Docker, Terraform, Git, Python, Unix, Go

The most amazing...

...thing I've built is an ML-inference engine, implementing a graph database from scratch into production with continuous integration, delivery, and orchestration.

Work Experience

Data Modeling Engineer

2022 - 2022

Gartner

Migrated a legacy workflow to a modern distributed system for a global IT consulting group, significantly increasing efficiency and scalability.
Analyzed the legacy system and identified areas for improvement; developed and implemented a plan to refactor the process.
Created tools to semi-automate documenting a database, resulting in increased efficiency and effectiveness for data management. Documentation was updated automatically to Confluence on each migration.
Created an infrastructure for running machine learning models on call transcripts, to determine call quality and analyze large volumes of data, including feature extraction and model deployment.

Technologies: Relational Databases, Data Modeling, Go, PHP, Amazon DynamoDB, Amazon Aurora, Microservices Architecture, Microservices, Architecture, System Architecture Design, DevOps, GitHub, Amazon S3 (AWS S3), Distributed Systems, Jira, Cloud Storage, AWS IAM, Cloud Architecture, Software Architecture, ETL, Git, Command-line Interface (CLI), Amazon Web Services (AWS), Data Architecture, REST APIs, CI/CD Pipelines, Web Scraping, Data Scraping, REST, GraphQL, Containerization, API Integration, Data Science, Data Engineering, Data Visualization, Web Development, Full-stack

Search Management

2019 - 2021

World’s Leading Manufacturer of Construction and Mining Equipment

Implemented a search analysis to understand and optimize performance in search queries.
Provided recommendations and best practices using search indices.
Improved performance on periodic ingestion-data processes.

Technologies: Azure Search, Azure, Microservices Architecture, Microservices, Architecture, System Architecture Design, Back-end, DevOps, GitHub, Amazon S3 (AWS S3), Distributed Systems, Jira, Cloud Storage, AWS IAM, Cloud Architecture, Software Architecture, ETL, Git, Command-line Interface (CLI), Amazon Web Services (AWS), Data Architecture, REST APIs, MQTT, CI/CD Pipelines, Data Scraping, REST, Containerization, API Integration, gRPC, Artificial Intelligence (AI), Data Science, Data Engineering, Web Development, Full-stack, Java, Automated Testing

Senior Back-end Developer

2018 - 2019

Leading Multinational Professional Services (under NDA)

Architected and developed a high-performance data ingestion system to infer knowledge from vendor-agnostic robotic process automation.
Ideated and implemented a development lifecycle, starting with requirement definition in plain English, turning requirements into automated acceptance steps with automated integration (CI), delivery (CD), and platform orchestration.
Developed tools and processes for team members to improve performance and product stability.

Technologies: Robotic Process Automation (RPA), Amazon Web Services (AWS), Redis, Terraform, Elasticsearch, Kubernetes, Go, PostgreSQL, Kibana, Logstash, logstash-forwarder, Microservices Architecture, Microservices, Architecture, System Architecture Design, Back-end, React, DevOps, Full-stack Development, GitHub, Amazon S3 (AWS S3), Distributed Systems, Jira, Cloud Storage, AWS IAM, Automation, Cloud Architecture, Software Architecture, ETL, Git, Command-line Interface (CLI), REST APIs, CI/CD Pipelines, Web Scraping, Data Scraping, REST, Containerization, .NET, Google Cloud Platform (GCP), API Integration, gRPC, Fintech, TradingView, Forex Trading, Data Science, Web Development, Full-stack, Java, Automated Testing, SaaS

Data Architect

2017 - 2018

Computer Security Company (under NDA)

Architected and developed a machine learning inference system using graph theory.
Implemented a wide variety of data ingesters from online data sources using different strategies: Crawling, API, and more.
Implemented strong development lifecycle using strong testing, CI/CD for the team.

Technologies: GRAPH, Redis, Kubernetes, Docker, Elasticsearch, APIs, Microservices Architecture, Microservices, Architecture, System Architecture Design, IT Project Management, React, DevOps, Full-stack Development, GitHub, Amazon S3 (AWS S3), Distributed Systems, Cloud Storage, AWS IAM, Automation, Natural Language Processing (NLP), Cloud Architecture, Software Architecture, System Design, ETL, Git, Command-line Interface (CLI), Amazon Web Services (AWS), Internet of Things (IoT), REST APIs, Technical Leadership, CI/CD Pipelines, Data Scraping, REST, Containerization, .NET, Google Cloud Platform (GCP), API Integration, Data Science, Data Engineering, Full-stack, SaaS

CTO

2013 - 2017

Nitidum Pty, Ltd.

Ideated, architected, and built a data cluster able to identify business opportunities using online information.
Built crawling engines to feed information. Some of the work turned into open-source projects and contributions to existing ones.
Managed infrastructure at a scale using automated provisioning and deployment using Chef.
Integrated instrumentation in Elasticsearch before it became an industry-leading solution for the purpose (ELK).

Technologies: Scrapy, PostgreSQL, Redis, Elasticsearch, Chef, Hadoop, Python, Architecture, CTO, DevOps, Full-stack Development, GitHub, Amazon S3 (AWS S3), Distributed Systems, Cloud Storage, Cloud Architecture, Software Architecture, System Design, Trading, ETL, Git, Command-line Interface (CLI), REST APIs, MQTT, Automated Trading Software, Technical Leadership, Project Management, Web Scraping, Data Scraping, Containerization, Cryptocurrency, API Integration, Trading Systems, MetaTrader, C, MetaTrader 5, MetaTrader 4, Artificial Intelligence (AI), Data Science, Data Visualization, Web Development, Full-stack, Team Leadership

CTO

2014 - 2016

Education Sector

Led the technical direction of the organization.
Supported a team of developers.
Set up an onboarding process.
Automated the development lifecycle.

Technologies: Redis, RabbitMQ, SQL, JavaScript, Node.js, Elasticsearch, Docker, Architecture, CTO, DevOps, Full-stack Development, GitHub, Cloud Architecture, Software Architecture, System Design, Git, Command-line Interface (CLI), Technical Leadership, Project Management, Data Scraping, Artificial Intelligence (AI), Data Science, Data Visualization, Web Development, Full-stack, Team Leadership, SaaS

Analyst, Developer

2007 - 2013

Resco Manager

Created a large modular web application using Django with Google Earth integration.
Designed and implemented variable data structures to process the complexity of the business requirements.
Prepared the teaching materials for the deployment distributed across multiple countries.

Technologies: Google Earth, Google Earth KML, MySQL, Django, Architecture, Full-stack Development, GitHub, Automation, Cloud Architecture, Software Architecture, System Design, Git, Command-line Interface (CLI), Internet of Things (IoT), Web Development, Full-stack

Technical Manager

2000 - 2013

AtCUBIC

Created the first large-scale automated web hosting platform in Spain.
Implemented high availability SLA for network and operations.
Created a service to orchestrate Linux servers in the pre-cloud era.

Technologies: Red Hat Linux, Unix, Python, Linux, Architecture, CTO, Full-stack Development, GitHub, Automation, Command-line Interface (CLI), Web Development, Full-stack, Team Leadership

Experience

RPA Aggregator

An RPA-agnostic aggregator for monitoring distributed-process automation with complete API support.

Built using Go, ElasticSearch, Beats, and Logstash on a CI/CD pipeline deploying automatically into Kubernetes clusters using Terraform.

Ontology-based Inference System

Built an ontology-based inference system for a security company, using a graph database and Elasticsearch on a Kubernetes cluster.

Used Prometheus and Grafana for instrumentation, Sentry for exception reporting, and Beats and Logstash for log centralization.

High-capacity Broad Crawler

Built a high-capacity broad crawler for a finance-sector company to identify potential business opportunities.

Data were indexed in an Elasticsearch cluster built on a Kubernetes cluster, instrumented with Prometheus and Grafana with exceptions handled by Sentry and logs centralized with Logstash and Beats.

RescoManager

An open-source, web-based software application for managing technical, financial, and logistical aspects of remote area-electrification projects.

Developed a blockchain-precursor technology to synchronize disconnected data pools.

Django Tastypie | Elasticsearch Support

https://github.com/llonchj/django-tastypie-elasticsearch

Elasticsearch support for Django Tastypie. Exposing Elasticsearch data through the Tastypie REST interface, allowing data in indices to be edited. This project was part of an experiment to integrate Elasticsearch information with Django.

ScraPy Sentry Plugin

https://github.com/llonchj/scrapy-sentry

Scrapy-Sentry is an open-source project that allows the integration of Sentry error tracking with Scrapy, a popular Python framework for web scraping. This integration enables users to track and report errors during web scraping to Sentry, a cloud-based error-tracking platform. With Scrapy-Sentry, developers can easily set up error tracking for their Scrapy projects, giving them more visibility into the performance and stability of their scrapers and enabling them to identify and fix issues as they arise quickly.

Plugin for YOURLS URL Shortener

https://github.com/llonchj/yourls_plugins

A plugin to forward a query string in a shortened URL.

Hypertable Cookbook for Chef

https://github.com/llonchj/chef_hypertable

A cookbook for a Hypertable distributed database like Google's BigTable.

Munin Plugin for Hypertable

https://github.com/llonchj/hypertable-munin

A Munin plugin to monitor a Hypertable cluster.

Financial Arbitrage Engine

A high-speed financial arbitrage engine to profit from different markets and exchange price inefficiencies. Built using Go and InfluxDB as a main time series database and using Grafana as the main user interface.

MT5 Algorithmic Expert Advisors (Trading Robots)

Built multiple expert advisors for the MT5 platform using multiple decisions based on technical indicators, with filters and equity management protection. The algorithm can trade currencies, crypto, and stocks.

Education

2013 - 2014

Coursera Certificate Degree in Data Analysis

Johns Hopkins University - Remote

2013 - 2013

Coursera Certificate Degree in Big data

Indian Institute of Technology Delhi - Remote

2013 - 2013

Coursera Certificate Degree in Machine Learning

Stanford - Remote

Skills

Libraries/APIs

Tastypie, jQuery, Beautiful Soup, Django ORM, REST APIs, SQLAlchemy, Scikit-learn, SciPy, Matplotlib, jQuery Mobile, AngularUI, jQuery UI, ZeroMQ, Protobuf, React, Pydantic, Node.js, Backbone.js, Vue 2, Google Maps

Tools

Logstash, Apache HTTP Server, RabbitMQ, Postfix, NGINX, ActiveMQ, Chef, Haystack, Vagrant, Terraform, Cucumber, GitHub, Jira, Git, Terminal, Azure Search, Azure Kubernetes Service (AKS), Google Kubernetes Engine (GKE), BrowserStack, AWS IAM, MQTT, ELK (Elastic Stack), Open Office, Scraping Hub, TextMate, OpenRefine, Sentry, GIS, Grafana, Kibana, logstash-forwarder

Languages

Go, SQL, HTML5, Python, Python 3, JavaScript, Ruby, GraphQL, C, PHP, C++, Java

Frameworks

Scrapy, Django, Flask, GeoDjango, Selenium, gRPC, Django REST Framework, .NET, Hadoop, Bootstrap, AngularJS

Paradigms

Functional Programming, Testing, Automation, REST, E2E Testing, Management, Continuous Deployment, Continuous Delivery (CD), Continuous Integration (CI), Test Automation, Microservices Architecture, Microservices, DevOps, Automated Testing, Agile, ETL, Test-driven Development (TDD)

Platforms

MacOS, Docker, Linux, MetaTrader, MetaTrader 5, Amazon Web Services (AWS), Red Hat Linux, AWS Lambda, Kubernetes, Apache Kafka, Google Cloud Platform (GCP), MetaTrader 4, Unix, Azure, Azure Functions

Storage

JSON, Redis, BigTable, MySQL, PostgreSQL, MongoDB, Hypertable, NoSQL, Elasticsearch, Amazon S3 (AWS S3), Memcached, Azure Cache, Graph Databases, GeoServer, Google Cloud, HBase, SQLite, InfluxDB, Relational Databases, Amazon DynamoDB, Amazon Aurora

Industry Expertise

Trading Systems, Project Management

Other

Scraping, Integration, Unix/Linux Virtualization, Virtualization, HTTP, Dovecot, A/B Testing, UI Testing, People Management, Web Scraping, Prometheus, Grafana 2, Robotic Process Automation (RPA), QA Automation, Software Development, Architecture, IT Project Management, Back-end, CTO, Distributed Systems, Cloud Storage, Software Architecture, System Design, Command-line Interface (CLI), Data Architecture, Automated Trading Software, Technical Leadership, Data Scraping, Containerization, API Integration, Data Science, Data Engineering, FastAPI, APIs, Cloud, Pipelines, Serverless, Machine Learning, BIND9, GeoJSON, Kubernetes Operations (kOps), Continuous Monitoring, Automation Tools, System Architecture Design, Full-stack Development, Natural Language Processing (NLP), Cloud Architecture, Trading, Internet of Things (IoT), CI/CD Pipelines, Cryptocurrency, TradingView, Forex Trading, Artificial Intelligence (AI), Data Visualization, Web Development, Full-stack, Solution Architecture, Geospatial Data, Mapping, Team Leadership, SaaS, GRAPH, Google Earth KML, Google Earth, Fintech, Data Analysis, Big Data, Instrumentation, Beats, GraphDB, Large-scale Web Crawlers, Web Crawlers, Monitoring, Data Modeling

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring