Javi Ramos, AWS Developer in London, United Kingdom
Javi Ramos

AWS Developer in London, United Kingdom

Member since November 13, 2018
Javi is a software engineer focused on data-intensive distributed systems. He helped architect and build multiple services running on Airflow, Kafka, and Spark and deploy fresh installations of those technologies. Those included leveraging the most current DevOps best practices like infrastructure as code using Terraform and Docker. Javi keeps himself up to date by pursuing certifications like AWS Solutions Architect, Databricks Apache Spark, and Astronomer’s Apache Airflow.
Javi is now available for hire

Portfolio

  • KafkaIDE
    Electron, Vue.js, Apache Kafka, Kotlin, Nuxt.js, TypeScript, JavaScript, NestJS
  • Simply Business
    SQL, Python, Scala, AWS Kinesis, Apache Spark, Snowflake, Redshift...
  • Hotelbeds Group
    Ansible, Docker, Scala, Python, Snowflake, Apache Hive, MapReduce, HDFS...

Experience

Location

London, United Kingdom

Availability

Part-time

Preferred Environment

MacOS, Unix, Git, IntelliJ IDEA, Vim Text Editor, JetBrains, WebStorm

The most amazing...

...project I architected and implemented is a desktop application that enabled over 300 different businesses to interact with streaming data in a visual way.

Employment

  • Senior Software Engineer

    2020 - 2021
    KafkaIDE
    • Designed and developed the desktop application, which enables you to query Apache Kafka clusters in a visual way and is used by over 300 developers from different businesses during the product lifetime.
    • Architected and implemented the infrastructure, back-end services, and front-end site to support the business operations of distribution and administration of the main desktop application.
    • Worked on implementation of dynamic schema inference from unstructured data in Apache Kafka topics, self-service filtering, and aggregation for queries.
    Technologies: Electron, Vue.js, Apache Kafka, Kotlin, Nuxt.js, TypeScript, JavaScript, NestJS
  • Senior Software Engineer

    2019 - 2020
    Simply Business
    • Implemented CI/CD using schemas to provide automatic creation of pipelines and warehouse tables, reducing administration overhead.
    • Worked on administration, monitoring, and tuning of Kafka clusters.
    • Developed and maintained Scala and Kotlin apps that rely on Kafka Consumer and Kafka Stream and providing Python and Scala libraries to facilitate Kafka’s usage across the company.
    • Played a principal role in the data warehouse migration from Redshift to Snowflake.
    • Developed and maintained the mainstreaming events pipeline, from the client and server-side event collection all the way until the warehouse which involves schema validation, deduplication, enrichment, shredding, and sessionization.
    • Organized and led level-ups and workshops for the data team to facilitate the adoption of the newly introduced paradigms and technologies.
    Technologies: SQL, Python, Scala, AWS Kinesis, Apache Spark, Snowflake, Redshift, Apache Airflow, Apache Kafka, Kotlin, Vue.js, JavaScript, TypeScript
  • Software Engineer

    2018 - 2019
    Hotelbeds Group
    • Played a key role in the migration of a legacy ETL platform to a new Apache Airflow instance, always having in mind scalability and reliability.
    • Developed and designed pipelines using Apache Airflow and Apache Spark.
    • Built pipelines that move over two billion rows on a daily basis.
    • Administrated and extended Hortonworks Hadoop distribution (HDFS, YARN, MapReduce, Apache Spark, Ambari, Ranger, and Zeppelin Notebooks).
    • Integrated to a large variety of systems such as Salesforce, Apache Kafka, many relational databases such as MSSQL, PostgreSQL, Oracle, other data warehouse databases such as Snowflake, and filesystems such as S3, HDFS, FTP, and SCP servers.
    Technologies: Ansible, Docker, Scala, Python, Snowflake, Apache Hive, MapReduce, HDFS, Hadoop, Apache Kafka, Apache Spark, Apache Airflow
  • Android Developer

    2016 - 2018
    Plaiout
    • Maintained and further extended with new features the main company's Android application.
    • Played a key role on the company's architecture design in order to enable easier implementation of new features.
    Technologies: Kotlin, Java, JVM, Android
  • Full Stack Engineer

    2015 - 2016
    Logitravel
    • Played a key role on the development of a new pricing data platform, which allowed business lines to develop and deploy more fine-grained pricing strategies.
    • Migrated legacy databases into more full featured consolidated database designs.
    • Involved in other projects such as booking recommendation system.
    Technologies: Visual Basic, C#, PostgreSQL, Microsoft SQL Server

Experience

  • Apache Kafka Visualization Tool
    https://kafkaide.com

    • Architected and developed multi-platform desktop visualization tool using Vue.js/Electron.js for the visual aspect with embedded Spring Boot/Kotlin webserver synced using Sockets.
    • Worked on implementing dynamic schema inference from unstructured data in Apache Kafka topics, self-service filtering, and aggregation for queries.

  • Events Streaming Platform

    • Played a crucial role in developing and maintaining the mainstreaming events pipeline, from the client and server-side event collection until the warehouse, which involves schema validation, deduplication, enrichment, shredding, and sessionization.
    • Led the migration from Apache Spark, Hadoop, and Scala to a containerized solution based on Apache Kafka, Kotlin, and Springboot, which significantly reduced the time to implement and roll out new features.
    • Organized and led level-ups and workshops for the data team to facilitate adopting the newly introduced paradigms and technologies.

  • 2nd Position Winner Data Science Hackathon @ Barceló Hotel Group

    Hackathon challenge: What's the likelihood that a certain customer is going to cancel a booking?

    Prize obtained achieving the second position: Camera GoPro alike product.

  • Paper: MPADE: An Improved Adaptive Multi-Population Differential Evolution Algorithm Based on JADE

    A scientific paper published in IEEE.

    This paper proposes MPADE algorithm, a Differential Evolution algorithm variant which extends JADE by using a multi-populated approach to solve high dimensional real-parameter constrained optimization problems. This mechanism helps to prevent the two well-known issues affecting the differential evolution algorithm, which are premature convergence and stagnation. MPADE implements ”DE/current-to-pbest” as its mutation strategy, adapts its mutation rate and the crossover rate, and uses an optional external archive to keep track of potential removed individuals in previous generations.

  • ATM Location Optimization @ European Space Agency
    https://livestream.com/ESA/SpaceAppCamp2016/videos/13624672

    European Space Agency selected 20 developers from all over the world to its ESRIN location in Frascati, Italy (including travel expenses and accommodation). The goal was to create during a week a mobile application using Copernicus satellites data that solved a problem in Smart Cities.

    You can see the final speech against the jury at the following link https://livestream.com/ESA/SpaceAppCamp2016/videos/136246728 (our speech starts at 1:51:00.

    ATM Location Optimization' gives you the best areas inside a city to place an ATM office in order to save energy and money (air conditioning) and to avoid air pollution.

Skills

  • Languages

    Python, Java, SQL, Scala, Snowflake, Kotlin, C#, Visual Basic, TypeScript, JavaScript
  • Frameworks

    Electron, Nuxt.js, Apache Spark, Hadoop, YARN, NestJS, Spring
  • Libraries/APIs

    Vue.js, Salesforce Bulk API
  • Tools

    Apache Airflow, Vim Text Editor, PyCharm, IntelliJ IDEA, Git, JetBrains, WebStorm, Terraform, Ansible
  • Storage

    AWS S3, Redshift, HDFS, Microsoft SQL Server, PostgreSQL, Apache Hive
  • Other

    AWS, Data Warehouse Design, Data Warehousing
  • Paradigms

    Clean Architecture, Design Patterns, MapReduce, Test-driven Development (TDD)
  • Platforms

    Docker, Unix, MacOS, Android, JVM, AWS Kinesis, Apache Kafka, Oracle

Education

  • Master's degree equivalent in Computer Engineering
    2016 - 2017
    Mälardalen University - Sweden
  • Bachelor's degree in Computer Engineering
    2013 - 2017
    Universitat de les Illes Balears - Spain
  • Bachelor's degree in Medicine
    2011 - 2013
    Universitat de Barcelona - Spain

Certifications

  • Apache Airflow
    MARCH 2021 - PRESENT
    Astronomer
  • Apache Spark 2.x for Scala
    NOVEMBER 2018 - PRESENT
    Databricks
  • AWS Solutions Architect - Associate Level
    OCTOBER 2018 - OCTOBER 2021
    Amazon Web Services

To view more profiles

Join Toptal
Share it with others