Javi Ramos
Verified Expert in Engineering
Software Developer
Javi is a software engineer focused on data-intensive distributed systems. He helped architect and build multiple services running on Airflow, Kafka, and Spark and deploy fresh installations of those technologies. Those included leveraging the most current DevOps best practices like infrastructure as code using Terraform and Docker. Javi keeps himself up to date by pursuing certifications like AWS Solutions Architect, Databricks Apache Spark, and Astronomer’s Apache Airflow.
Portfolio
Experience
Availability
Preferred Environment
MacOS, Unix, Git, IntelliJ IDEA, Vim Text Editor, JetBrains, WebStorm
The most amazing...
...project I architected and implemented is a desktop application that enabled over 300 different businesses to interact with streaming data in a visual way.
Work Experience
Senior Software Engineer
KafkaIDE
- Designed and developed the desktop application, which enables you to query Apache Kafka clusters in a visual way and is used by over 300 developers from different businesses during the product lifetime.
- Architected and implemented the infrastructure, back-end services, and front-end site to support the business operations of distribution and administration of the main desktop application.
- Worked on implementation of dynamic schema inference from unstructured data in Apache Kafka topics, self-service filtering, and aggregation for queries.
Senior Software Engineer
Simply Business
- Implemented CI/CD using schemas to provide automatic creation of pipelines and warehouse tables, reducing administration overhead.
- Worked on administration, monitoring, and tuning of Kafka clusters.
- Developed and maintained Scala and Kotlin apps that rely on Kafka Consumer and Kafka Stream and providing Python and Scala libraries to facilitate Kafka’s usage across the company.
- Played a principal role in the data warehouse migration from Redshift to Snowflake.
- Developed and maintained the mainstreaming events pipeline, from the client and server-side event collection all the way until the warehouse which involves schema validation, deduplication, enrichment, shredding, and sessionization.
- Organized and led level-ups and workshops for the data team to facilitate the adoption of the newly introduced paradigms and technologies.
Software Engineer
Hotelbeds Group
- Played a key role in the migration of a legacy ETL platform to a new Apache Airflow instance, always having in mind scalability and reliability.
- Developed and designed pipelines using Apache Airflow and Apache Spark.
- Built pipelines that move over two billion rows on a daily basis.
- Administrated and extended Hortonworks Hadoop distribution (HDFS, YARN, MapReduce, Apache Spark, Ambari, Ranger, and Zeppelin Notebooks).
- Integrated to a large variety of systems such as Salesforce, Apache Kafka, many relational databases such as MSSQL, PostgreSQL, Oracle, other data warehouse databases such as Snowflake, and filesystems such as S3, HDFS, FTP, and SCP servers.
Android Developer
Plaiout
- Maintained and further extended with new features the main company's Android application.
- Played a key role on the company's architecture design in order to enable easier implementation of new features.
Full Stack Engineer
Logitravel
- Played a key role on the development of a new pricing data platform, which allowed business lines to develop and deploy more fine-grained pricing strategies.
- Migrated legacy databases into more full featured consolidated database designs.
- Involved in other projects such as booking recommendation system.
Experience
Apache Kafka Visualization Tool
https://kafkaide.com• Worked on implementing dynamic schema inference from unstructured data in Apache Kafka topics, self-service filtering, and aggregation for queries.
Events Streaming Platform
• Led the migration from Apache Spark, Hadoop, and Scala to a containerized solution based on Apache Kafka, Kotlin, and Springboot, which significantly reduced the time to implement and roll out new features.
• Organized and led level-ups and workshops for the data team to facilitate adopting the newly introduced paradigms and technologies.
2nd Position Winner Data Science Hackathon @ Barceló Hotel Group
Prize obtained achieving the second position: Camera GoPro alike product.
Paper: MPADE: An Improved Adaptive Multi-Population Differential Evolution Algorithm Based on JADE
This paper proposes MPADE algorithm, a Differential Evolution algorithm variant which extends JADE by using a multi-populated approach to solve high dimensional real-parameter constrained optimization problems. This mechanism helps to prevent the two well-known issues affecting the differential evolution algorithm, which are premature convergence and stagnation. MPADE implements ”DE/current-to-pbest” as its mutation strategy, adapts its mutation rate and the crossover rate, and uses an optional external archive to keep track of potential removed individuals in previous generations.
ATM Location Optimization @ European Space Agency
https://livestream.com/ESA/SpaceAppCamp2016/videos/13624672You can see the final speech against the jury at the following link https://livestream.com/ESA/SpaceAppCamp2016/videos/136246728 (our speech starts at 1:51:00.
ATM Location Optimization' gives you the best areas inside a city to place an ATM office in order to save energy and money (air conditioning) and to avoid air pollution.
Skills
Languages
Python, Java, SQL, Scala, Snowflake, Kotlin, C#, Visual Basic, TypeScript, JavaScript
Frameworks
Electron, Nuxt.js, Apache Spark, Hadoop, YARN, NestJS, Spring
Libraries/APIs
Vue, Salesforce Bulk API
Tools
Apache Airflow, Vim Text Editor, PyCharm, IntelliJ IDEA, Git, JetBrains, WebStorm, Terraform, Ansible
Platforms
Amazon Web Services (AWS), Docker, Unix, MacOS, Android, JVM, Apache Kafka, Oracle
Storage
Amazon S3 (AWS S3), Redshift, HDFS, Microsoft SQL Server, PostgreSQL, Apache Hive
Paradigms
Clean Architecture, Design Patterns, MapReduce, Test-driven Development (TDD)
Other
Amazon Kinesis, Data Warehouse Design, Data Warehousing
Education
Master's Degree Equivalent in Computer Engineering
Mälardalen University - Sweden
Bachelor's Degree in Computer Engineering
Universitat de les Illes Balears - Spain
Bachelor's Degree in Medicine
Universitat de Barcelona - Spain
Certifications
Apache Airflow
Astronomer
Apache Spark 2.x for Scala
Databricks
AWS Solutions Architect - Associate Level
Amazon Web Services
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring