Radu is available for hire

Radu Chilom

Verified Expert in Engineering

Big Data Engineer and Database Developer

Location

Barcelona, Spain

Toptal Member Since

March 25, 2021

Radu is a software engineer with nearly a decade of experience, excels in data engineering, and is a strong tech lead. Radu has delivered a variety of projects, including ETL pipelines, data platforms, and analytics. As a tech lead, Radu led both on-site and remote teams, handling architecture and data modeling, implementing Agile and software development best practices, stakeholder management, risk management, mentoring and hiring.

Software Engineering Big Data ETL Scala Spark Apache Spark Databricks Big Data Architecture Agile SQL MacOS Spark SQL Continuous Deployment NoSQL Akka Spray

Portfolio

ThoughtWorks

Scala, React, Elastic, Apache Kafka, Amazon Web Services (AWS), Agile...

Blueprint

Data Virtualization, Spark, SQL, NoSQL, Scala, ELK (Elastic Stack)...

Ubix Labs

Amazon Web Services (AWS), Big Data, Big Data Architecture, Scala, Spark...

Experience

Software Engineering - 9 years ETL - 6 years Big Data - 6 years Agile - 5 years Scala - 5 years Spark - 5 years SQL - 5 years

Availability

Part-time

Preferred Environment

Scala, Spark, Big Data, Amazon Web Services (AWS), IntelliJ IDEA, MacOS

The most amazing...

...implementation I've led was for Ubix Engine, a big data platform that enables data science automation and advanced analytics applications.

Work Experience

Senior Consultant

2019 - 2021

ThoughtWorks

Led the team managing the entry points of a leading international marketplace. Led initiatives that were providing new features while at the same time refactoring a legacy codebase.
Assisted in improving the process of the team. In a relatively short time, the team adopted TDD (test-driven development), CD (continuous deployment), knowledge sharing, a feedback culture, and defined the tech vision and the definition of "done."
Supported and influenced the client to adopt a data-driven approach. By making better use of their data they made better business decisions.
Managed and coordinated the required technical steps to handle a data leak incident.
Participated in setting up the development plan for an analytics pipeline by gathering business requirements and defining the architecture.

Technologies: Scala, React, Elastic, Apache Kafka, Amazon Web Services (AWS), Agile, Continuous Deployment, Test-driven Development (TDD), Knowledge Sharing

Senior Big Data Consultant

2017 - 2019

Blueprint

Led implementation for multiple components of Conduit, a lightweight data virtualization solution that provides secure connections to multiple data sources in real-time.
Played an important part in defining the architecture and data modeling.
Built and optimized data pipeline components such as database sinks, cloud data extractors, and Spark processing pipelines.
Mentored and supported members of the team in completing tasks, achieving team objectives, and personal goals.
Part of a fully remote team with people on three continents and large time zone differences.

Technologies: Data Virtualization, Spark, SQL, NoSQL, Scala, ELK (Elastic Stack), Amazon Web Services (AWS), PostgreSQL

Technical Lead

2015 - 2017

Ubix Labs

Led a team of six people towards building the Ubix Engine, a data platform that enables data science automation and analytics applications.
Set up the groundwork for the Romanian office and built a team of six engineers.
Guided the defining of the architecture and data modeling for complex problems.
Advocated for and implemented software development best practices in the team.
Mentored and supported members of the team in completing tasks and achieving team objectives and personal goals.

Technologies: Amazon Web Services (AWS), Big Data, Big Data Architecture, Scala, Spark, Spark Streaming, ELK (Elastic Stack), Akka, Apache Hive, Cassandra, Spark SQL, HDFS, Spark ML

Big Data Engineer

2013 - 2015

Atigeo

Assisted the team that delivered end-to-end solutions to big data projects in an Agile environment.
Assisted with ETL pipelines, financial/healthcare analytics, and several components of XPatterns Connect, a big data analytics platform.
Contributed to ambitious open source projects, main committer on Spark-Job-Rest-a highly scalable RESTful interface for submitting and managing Spark jobs and contexts.

Technologies: Agile, Spark, Spark SQL, Hadoop, MapReduce, Apache Hive, Cassandra, NoSQL, SQL, Mesos, Scala, Java, Akka, spray, Apache Kafka, Amazon Web Services (AWS), Jenkins

Experience

Conduit

A lightweight data virtualization solution with a robust query engine that provides secure connections to multiple data sources in real-time access. I led the implementation of multiple core components.

Ubix Engine

A big data science platform that enables data science automation and advanced analytics applications in cancer genomics research, IoT, oil and gas. Supporting both batch processing and real-time streaming under a unified Lambda architecture, the engine operates on data in various stores. As a tech lead, I had a key role in defining architecture and data modeling while leading the implementation and providing technical guidance for the team.

XPatterns Connect

https://aws.amazon.com/marketplace/pp/B00W5VHD20/

A big data analytics platform that has the power of distributing your ingestion, transformation, predictive analytics, and algorithms automatically. The platform serves large-scale analytics, including population health management and medical fraud detection. I was a data engineer working on several core components of the platform.

Spark-Job-Rest

https://github.com/VeritoneAlpha/spark-job-rest

A highly scalable RESTful interface for submitting and managing Spark jobs and contexts. SJR was created to overcome the inability to run multiple Spark contexts from the same JVM by spinning a new process for each Spark application. I was the main contributor of this open source project.

Public Speaker

https://bit.ly/3w0khtJ

Speaker at big data meet-ups in Timisoara, Bucharest, and Barcelona. Co-speaker at Berlin Buzzwords with the talk “In-memory data pipeline and warehouse at scale.”

Skills

Languages

Scala, SQL, Java, Python

Frameworks

Spark, Apache Spark, Akka, Hadoop

Tools

IntelliJ IDEA, Spark SQL, Elastic, ELK (Elastic Stack), Mesos, Jenkins, Tableau, Microsoft Power BI

Paradigms

ETL, Agile, Continuous Deployment, Continuous Development (CD), Continuous Integration (CI), Continuous Delivery (CD), Pair Programming, Microservices, MapReduce, Test-driven Development (TDD)

Platforms

MacOS, Databricks, Apache Kafka, Amazon Web Services (AWS), AWS Cloud Computing Services

Other

Data, Big Data, Engineering, Software Engineering, Big Data Architecture, Data Virtualization, Mentorship, Public Speaking, Software Design, Knowledge Sharing, Team Mentoring, Meetups, Open Source, Cloud Computing, Cloud Platforms, Cloud Services, AWS Certified Developer, Architecture, AWS Cloud Architecture, Cloud Architecture

Libraries/APIs

Spark Streaming, React, Spark ML, spray

Storage

NoSQL, Apache Hive, Amazon S3 (AWS S3), PostgreSQL, Cassandra, HDFS

Education

2009 - 2013

Bachelor's Degree in Computer Science

Polytechnic University of Timişoara - Timişoara, Romania

Certifications

JUNE 2021 - JUNE 2024

AWS Certified Solutions Architect Associate

AWS

MAY 2021 - MAY 2024

AWS Certified Cloud Practitioner

Amazon Web Services Training and Certification

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring