Javi Ramos, Developer in London, United Kingdom
Javi is available for hire
Hire Javi

Javi Ramos

Verified Expert  in Engineering

Software Developer

Location
London, United Kingdom
Toptal Member Since
December 18, 2018

Javi is a software engineer focused on data-intensive distributed systems. He helped architect and build multiple services running on Airflow, Kafka, and Spark and deploy fresh installations of those technologies. Those included leveraging the most current DevOps best practices like infrastructure as code using Terraform and Docker. Javi keeps himself up to date by pursuing certifications like AWS Solutions Architect, Databricks Apache Spark, and Astronomer’s Apache Airflow.

Portfolio

KafkaIDE
Electron, Vue, Apache Kafka, Kotlin, Nuxt.js, TypeScript, JavaScript, NestJS
Simply Business
SQL, Python, Scala, Amazon Kinesis, Apache Spark, Snowflake, Redshift...
Hotelbeds Group
Ansible, Docker, Scala, Python, Snowflake, Apache Hive, MapReduce, HDFS, Hadoop...

Experience

Availability

Part-time

Preferred Environment

MacOS, Unix, Git, IntelliJ IDEA, Vim Text Editor, JetBrains, WebStorm

The most amazing...

...project I architected and implemented is a desktop application that enabled over 300 different businesses to interact with streaming data in a visual way.

Work Experience

Senior Software Engineer

2020 - 2021
KafkaIDE
  • Designed and developed the desktop application, which enables you to query Apache Kafka clusters in a visual way and is used by over 300 developers from different businesses during the product lifetime.
  • Architected and implemented the infrastructure, back-end services, and front-end site to support the business operations of distribution and administration of the main desktop application.
  • Worked on implementation of dynamic schema inference from unstructured data in Apache Kafka topics, self-service filtering, and aggregation for queries.
Technologies: Electron, Vue, Apache Kafka, Kotlin, Nuxt.js, TypeScript, JavaScript, NestJS

Senior Software Engineer

2019 - 2020
Simply Business
  • Implemented CI/CD using schemas to provide automatic creation of pipelines and warehouse tables, reducing administration overhead.
  • Worked on administration, monitoring, and tuning of Kafka clusters.
  • Developed and maintained Scala and Kotlin apps that rely on Kafka Consumer and Kafka Stream and providing Python and Scala libraries to facilitate Kafka’s usage across the company.
  • Played a principal role in the data warehouse migration from Redshift to Snowflake.
  • Developed and maintained the mainstreaming events pipeline, from the client and server-side event collection all the way until the warehouse which involves schema validation, deduplication, enrichment, shredding, and sessionization.
  • Organized and led level-ups and workshops for the data team to facilitate the adoption of the newly introduced paradigms and technologies.
Technologies: SQL, Python, Scala, Amazon Kinesis, Apache Spark, Snowflake, Redshift, Apache Airflow, Apache Kafka, Kotlin, Vue, JavaScript, TypeScript

Software Engineer

2018 - 2019
Hotelbeds Group
  • Played a key role in the migration of a legacy ETL platform to a new Apache Airflow instance, always having in mind scalability and reliability.
  • Developed and designed pipelines using Apache Airflow and Apache Spark.
  • Built pipelines that move over two billion rows on a daily basis.
  • Administrated and extended Hortonworks Hadoop distribution (HDFS, YARN, MapReduce, Apache Spark, Ambari, Ranger, and Zeppelin Notebooks).
  • Integrated to a large variety of systems such as Salesforce, Apache Kafka, many relational databases such as MSSQL, PostgreSQL, Oracle, other data warehouse databases such as Snowflake, and filesystems such as S3, HDFS, FTP, and SCP servers.
Technologies: Ansible, Docker, Scala, Python, Snowflake, Apache Hive, MapReduce, HDFS, Hadoop, Apache Kafka, Apache Spark, Apache Airflow

Android Developer

2016 - 2018
Plaiout
  • Maintained and further extended with new features the main company's Android application.
  • Played a key role on the company's architecture design in order to enable easier implementation of new features.
Technologies: Kotlin, Java, JVM, Android

Full Stack Engineer

2015 - 2016
Logitravel
  • Played a key role on the development of a new pricing data platform, which allowed business lines to develop and deploy more fine-grained pricing strategies.
  • Migrated legacy databases into more full featured consolidated database designs.
  • Involved in other projects such as booking recommendation system.
Technologies: Visual Basic, C#, PostgreSQL, Microsoft SQL Server

Apache Kafka Visualization Tool

https://kafkaide.com
• Architected and developed multi-platform desktop visualization tool using Vue.js/Electron.js for the visual aspect with embedded Spring Boot/Kotlin webserver synced using Sockets.
• Worked on implementing dynamic schema inference from unstructured data in Apache Kafka topics, self-service filtering, and aggregation for queries.

Events Streaming Platform

• Played a crucial role in developing and maintaining the mainstreaming events pipeline, from the client and server-side event collection until the warehouse, which involves schema validation, deduplication, enrichment, shredding, and sessionization.
• Led the migration from Apache Spark, Hadoop, and Scala to a containerized solution based on Apache Kafka, Kotlin, and Springboot, which significantly reduced the time to implement and roll out new features.
• Organized and led level-ups and workshops for the data team to facilitate adopting the newly introduced paradigms and technologies.

2nd Position Winner Data Science Hackathon @ Barceló Hotel Group

Hackathon challenge: What's the likelihood that a certain customer is going to cancel a booking?

Prize obtained achieving the second position: Camera GoPro alike product.

Paper: MPADE: An Improved Adaptive Multi-Population Differential Evolution Algorithm Based on JADE

A scientific paper published in IEEE.

This paper proposes MPADE algorithm, a Differential Evolution algorithm variant which extends JADE by using a multi-populated approach to solve high dimensional real-parameter constrained optimization problems. This mechanism helps to prevent the two well-known issues affecting the differential evolution algorithm, which are premature convergence and stagnation. MPADE implements ”DE/current-to-pbest” as its mutation strategy, adapts its mutation rate and the crossover rate, and uses an optional external archive to keep track of potential removed individuals in previous generations.

ATM Location Optimization @ European Space Agency

https://livestream.com/ESA/SpaceAppCamp2016/videos/13624672
European Space Agency selected 20 developers from all over the world to its ESRIN location in Frascati, Italy (including travel expenses and accommodation). The goal was to create during a week a mobile application using Copernicus satellites data that solved a problem in Smart Cities.

You can see the final speech against the jury at the following link https://livestream.com/ESA/SpaceAppCamp2016/videos/136246728 (our speech starts at 1:51:00.

ATM Location Optimization' gives you the best areas inside a city to place an ATM office in order to save energy and money (air conditioning) and to avoid air pollution.

Languages

Python, Java, SQL, Scala, Snowflake, Kotlin, C#, Visual Basic, TypeScript, JavaScript

Frameworks

Electron, Nuxt.js, Apache Spark, Hadoop, YARN, NestJS, Spring

Libraries/APIs

Vue, Salesforce Bulk API

Tools

Apache Airflow, Vim Text Editor, PyCharm, IntelliJ IDEA, Git, JetBrains, WebStorm, Terraform, Ansible

Platforms

Amazon Web Services (AWS), Docker, Unix, MacOS, Android, JVM, Apache Kafka, Oracle

Storage

Amazon S3 (AWS S3), Redshift, HDFS, Microsoft SQL Server, PostgreSQL, Apache Hive

Paradigms

Clean Architecture, Design Patterns, MapReduce, Test-driven Development (TDD)

Other

Amazon Kinesis, Data Warehouse Design, Data Warehousing

2016 - 2017

Master's Degree Equivalent in Computer Engineering

Mälardalen University - Sweden

2013 - 2017

Bachelor's Degree in Computer Engineering

Universitat de les Illes Balears - Spain

2011 - 2013

Bachelor's Degree in Medicine

Universitat de Barcelona - Spain

MARCH 2021 - PRESENT

Apache Airflow

Astronomer

NOVEMBER 2018 - PRESENT

Apache Spark 2.x for Scala

Databricks

OCTOBER 2018 - OCTOBER 2021

AWS Solutions Architect - Associate Level

Amazon Web Services

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring