Karip Kaya
Verified Expert in Engineering
Data Developer
Buckhurst Hill, United Kingdom
Toptal member since March 29, 2022
Karip is a data engineer and developer with 18 years of experience in the IT industry and six years in the freelance community. He specializes in Java, Scala, and Python and is skilled at Hadoop, Spark, and PL/SQL. Karip enjoys working on the back end, database, and big data projects.
Portfolio
Experience
- Java - 15 years
- SQL - 15 years
- Apache Hive - 5 years
- HDFS - 5 years
- Spark SQL - 3 years
- Spark - 3 years
- Scala - 3 years
- Python 3 - 2 years
Preferred Environment
Java, Scala, Python 3, SQL, Apache Hive, Spark, Databricks
The most amazing...
...thing I've developed is the messaging and file sharing program for desktop environments.
Work Experience
Senior Data Engineer
Atos
- Reduced the 14 hours to run a Pandas-based data-transformation code into a PySpark DataFrame, running in five minutes.
- Solved weekly pipeline data problems. Backloaded needed datasets.
- Contributed to maintaining the weekly data flow based on Azure Data Factory.
Senior Data Engineer
Groupon
- Worked on cloud migration of an in-house Java API by using Docker.
- Maintained the in-house data flow and the Linux crontab schedule maintenance.
- Solved the cloud API timeout problem by changing an existing Java code.
- Applied the CDC data flow function performance solution.
Data Engineer
Deutsche Bank
- Created an initial data pipeline integration with Hive, Spark, Scala, and PySpark from scratch.
- Solved file count limit problems with partitioning and bucketing Hive tables.
- Contributed to designing the DWH database model established on Hive.
Experience
Sudoku Validator
https://github.com/karipkaya/sudokuvalidatorI wrote it in Java, generated tests, and used Maven for dependency management and building and running operations. The purpose was to demonstrate basic Java, Maven, and test knowledge.
Certifications
Python Basic
HackerRank
Problem Solving (Basic)
HackerRank
SQL (Advanced)
HackerRank
Oracle Certified Associate
Oracle
Skills
Libraries/APIs
PySpark, Pandas
Tools
Spark SQL, Git, Informatica ETL, GitHub, Apache Maven, Oracle Exadata, Impala, CircleCI, Jenkins, JCL, Cloudera, Apache Sqoop, Bitbucket, Java Development Kit (JDK)
Languages
Java, SQL, Java 8, Scala, Python 3, Python, C
Frameworks
Spark, Apache Spark, Hadoop, Hibernate, Spring
Paradigms
ETL
Platforms
Oracle, Databricks, Azure, Linux, Kubernetes
Storage
Apache Hive, HDFS, PL/SQL, Databases, Data Pipelines, RDBMS, Oracle 11g, Oracle 12c
Other
Big Data, Data Migration, Data Engineering, ETL Development, Informatica, Azure Data Factory (ADF), COBOL Batch, Algorithms
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring