Soner Güzeloglu, Developer in Amsterdam, Netherlands
Soner is available for hire
Hire Soner

Soner Güzeloglu

Verified Expert  in Engineering

Data Engineer and Developer

Location
Amsterdam, Netherlands
Toptal Member Since
December 24, 2020

Soner is a data engineer and developer specializing in end-to-end data pipelines for both batch and streaming needs. He excels at building data-intensive applications with state-of-the-art technologies and has delivered projects in the domains of eCommerce, airline, and finance. Soner brings his passion, devotion, and unabated curiosity for computer science to every project he takes on.

Data EngineeringJavaSQLScalaETLData VisualizationData ModelingApache KafkaPostgreSQLAkkaConfluenceApache SparkPlay FrameworkGoogle Cloud Platform (GCP)Data WarehousingControl-MRocksDB

Portfolio

Payment Gateway Company
Apache Kafka, Apache Avro, KSQL, Amazon Web Services (AWS), RocksDB, Big Data
Ecommerce Company
Apache Avro, APIs, Data Pipelines, Google Data Studio, Apache Kafka...
Amadeus IT Group
Spark, ETL, Python, QlikView, Parquet, Qlik Sense, Oozie, Apache Hive, Hadoop...

Experience

Oracle RDBMS - 4 yearsData Engineering - 4 yearsApache Kafka - 3 yearsScala - 3 yearsAkka - 2 yearsLooker - 1 yearGoogle BigQuery - 1 year

Availability

Part-time

Preferred Environment

Google BigQuery, Google Cloud Platform (GCP), Apache Spark, Oracle RDBMS, Apache Kafka, Akka, Scala, Python, Looker, Data Build Tool (dbt)

The most amazing...

...thing I've developed is an eCommerce end-to-end data pipeline that enables real-time customer journey scenarios, alert mechanisms, and data-driven approaches.

Work Experience

Senior Software Engineer | Data Engineer

2021 - 2021
Payment Gateway Company
  • Designed and developed a real-time fraud detection application on transactions that the company receives with KSQL.
  • Implemented real-time streaming aggregation rules to trace user behavior in sessions.
  • Delivered a downstream application response under 500 milliseconds during peak hours.
Technologies: Apache Kafka, Apache Avro, KSQL, Amazon Web Services (AWS), RocksDB, Big Data

Data Engineer

2020 - 2021
Ecommerce Company
  • Developed an event collector using the Scala Play Framework to publish real-time incoming events from different sources (Android, iOS, web, and MWeb) into Kafka topics.
  • Designed and developed a Kafka consumer with Akka Streams, which streams data into BigQuery in real time.
  • Created a Google Data Studio dashboard for real-time event metrics.
Technologies: Apache Avro, APIs, Data Pipelines, Google Data Studio, Apache Kafka, Google BigQuery, Google Cloud Platform (GCP), Play Framework, Akka, Scala

Software Development Engineer

2018 - 2020
Amadeus IT Group
  • Designed and developed a data pipeline to enable the data for internal and external customers.
  • Built a data acquisition app to collect flown-passenger lists from airlines.
  • Designed and developed reporting dashboards to provide data insights such as flyer demography, airline liability, and geographic density graphs.
Technologies: Spark, ETL, Python, QlikView, Parquet, Qlik Sense, Oozie, Apache Hive, Hadoop, Oracle RDBMS, Apache Spark, Scala, Java

Software Development Engineer

2017 - 2018
Amadeus
  • Developed customer requests on a loyalty management system that's used by frequent flyers.
  • Built a back-end solution for agent auditing purposes.
  • Designed and developed a company-wide information share platform to improve the response time for incoming tickets.
Technologies: SOAP, REST APIs, PL/SQL, Oracle, Java

Real-time Data Warehouse for eCommerce

A data pipeline to extract transactions from Oracle into BigQuery and MicroStrategy through Confluent Kafka topics. I designed and developed a real-time data pipeline with streaming technologies, such as Striim for change data capture (CDC), Confluent Kafka and KSQL, BigQuery, and MicroStrategy. The pipeline extracts transactions from Oracle, PostgreSQL, and Mongo sources with CDC into Kafka topics. Then the Confluent BigQuery Sink Connector streams the transaction into BigQuery. MicroStrategy was used to visualize data from BigQuery.

Real-time Event Consumer with Akka Scala for eCommerce

A Kafka consumer with Scala Akka Streams that consumes incoming events from different channels (Android, iOS, web, and Mweb) into Google BigQuery. By implementing this service, I created an important value by making the events available in nearly real time for data science teams and enabled the real-time alert mechanisms for data engineering purposes.

Real-time Fraud Detection for Payment Gateway

A ksqlDB application on real-time payment transaction events to detect fraudulent activities on a platform. The application subscribes to the topics for incoming events and applies real-time rules with KSQL. It responds to the downstream application under 500 milliseconds to meet the agreement.

Event Analytics Dashboards for eCommerce

A Google Data Studio dashboard to visualize user events coming from Android, iOS, web, and MWeb in real time. I designed and developed hourly, daily, and monthly charts with pivot tables; used custom queries, data range pickers, data controls, and dropdowns, and implemented funnels to understand user behavior in detail.

Mobile Application ID Collection for eCommerce

A Scala-based Play Framework app to collect device IDs from web, MWeb, iOS, and Android devices. I designed and developed a POST endpoint for SDKs to collect incoming device IDs into Google BigQuery. I used Kafka topics to queue messages and Akka Streams to provide performance at scale.

Loyalty Analytics Dashboards for Airlines

A Qlik Sense-based dashboard that provides data insights for airlines. I designed and developed the solution to build flyer demography, airline liability, and geographic density reports for airlines. I used File Watchers to build the data acquisition layer, Apache Spark and Scala on the data processing layer, Oozie to schedule DAGs, Hive to serve the data for batch needs, and Qlik Sense to visualize the data.
2012 - 2017

Bachelor's Degree in Computer Engineering

Marmara University - Istanbul, Turkey

Libraries/APIs

REST APIs

Tools

Looker, Confluence, Qlik Sense, Control-M, Oozie, Apache Avro, BigQuery, Kafka Streams, Jenkins, Terraform, Sentry

Languages

Scala, Java, SQL, Python, Bash

Storage

Oracle RDBMS, Data Lakes, PostgreSQL, Apache Hive, Data Pipelines, PL/SQL, HBase, RocksDB, Datadog

Paradigms

ETL

Frameworks

Akka, Apache Spark, Play Framework, Hadoop, Spark

Platforms

Apache Kafka, Google Cloud Platform (GCP), Oracle, QlikView, Amazon Web Services (AWS), Docker, PagerDuty

Other

Data Engineering, CI/CD Pipelines, Google BigQuery, Data Visualization, Data Architecture, Data Modeling, Google Data Studio, APIs, SOAP, Parquet, Big Data, Data Warehousing, MicroStrategy, KSQL, Change Data Capture, Big Data Architecture, Data Warehouse Design, Data Build Tool (dbt), ksqlDB

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring