Oliver Kosta Zivic
Verified Expert in Engineering
Data Engineer and Developer
Belgrade, Serbia
Toptal member since November 26, 2024
Oliver is a senior data engineer with 10+ years of experience. He specializes in batch data processing and is skilled in Python, Java, Akka, and Scala development. He has a strong background in AWS management and DevOps tasks and handles the complete project lifecycle. Oliver has automated data pipelines for unorthodox data formats like maps and audio, led teams, and managed large-scale data solutions across industries, ensuring high-quality data processing and storage.
Portfolio
Experience
- Python - 13 years
- Java - 10 years
- Hadoop - 10 years
- PostgreSQL - 10 years
- Spark - 8 years
- Scala - 6 years
- Apache Kafka - 6 years
- Cassandra - 5 years
Availability
Preferred Environment
IntelliJ IDEA, PyCharm, DataGrip
The most amazing...
...thing I've worked on is the complete automation of data pipelines for unorthodox data formats, including maps and audio.
Work Experience
Senior Data Engineer
Toptal, LLC
- Handled the maintenance of the Toptal core platform's multiple orchestration solutions and data pipelines, mainly Luigi and Airflow, managing the storage solution built around BigQuery.
- Tracked and maintained issues and documentation using Jira and Confluence.
- Maintained pipelines that processed terabytes of data multiple times per day.
Senior Data Engineer | Senior Tech Lead | Data Solution Architect
HTEC Group
- Handled on-premise and cloud-based managed solutions, working with various data types, such as maps and audio. Created and maintained processing pipelines on Apache Spark, Scala, Akka, Java, and Python, including Cassandra, Solr, and Kafka.
- Oversaw a team of 35 data engineers across multiple projects, maintaining tech standards, providing mentorship, and handling code reviews.
- Engaged in multiple audit processes as a data solution architect, advising projects in the early stages and helping create and maintain different data architectures.
Senior Data Engineer | Tech Lead
Deploy
- Worked on a multiplatform solution with developed and integrated features, including data gathering and processing, an ML platform for lead generation, and financial data management and tracking with a full lifecycle of the data in BI platforms.
- Managed a customer acquisition platform and its users, ensuring zero downtime. Oversaw the PostgreSQL data warehouse, ETL processes, a Python and Scala back end, and real-time data analytics with Presto, Spark, Hive, AWS Glue, and Athena.
- Handled DevOps tasks, managed AWS, reported with Tableau and Qlik, built and maintained numerous Docker projects, and created and used a convolutional neural network for image recognition.
Data Engineer
CarStory
- Maintained and developed a vertical search engine utilizing a custom back end built in Java over Hadoop. Handled MapReduce jobs for data processing.
- Tracked and fixed bugs using Jira and maintained documentation using Confluence.
- Contributed to overall data pipelines and data quality.
Experience
Maps Core Functionality
Skills
Libraries/APIs
TensorFlow, Keras, Luigi
Tools
Terraform, Impala, Kafka Connect, Apache Solr, Apache Airflow, BigQuery, IntelliJ IDEA, PyCharm, DataGrip
Languages
Python, Java, Scala
Frameworks
Spark, Hadoop, Presto, Akka
Storage
PostgreSQL, Amazon S3 (AWS S3), Redshift, Amazon DynamoDB, Apache Hive, Cassandra
Platforms
Apache Kafka, Google Cloud Platform (GCP), Kubernetes
Other
EMR, Apache Cassandra, Theoretical Computer Science
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring