Sait Dogan
Verified Expert in Engineering
Data Engineer and Software Developer
London, United Kingdom
Toptal member since March 28, 2022
Sait is a data engineer with 15+ years of ETL development experience. He implemented many greenfield data warehouse projects in diverse sectors, such as telecommunications, banking, and insurance systems. For the last 5+ years, he's also been involved in big data projects.
Portfolio
Experience
- SQL - 15 years
- Oracle - 15 years
- PL/SQL - 15 years
- ETL - 15 years
- Apache Airflow - 5 years
- Python - 5 years
- Data Engineering - 5 years
- Informatica - 5 years
Preferred Environment
ETL, Data Engineering, Python, SQL, Informatica, Oracle Data Integrator (ODI)
The most amazing...
...thing I've designed and implemented is an enterprise data warehouse and self-service BI environment that serves more than 300 head office users.
Work Experience
Senior Data Engineer
Groupon
- Implemented a real-time data ingestion framework to BigQuery using DataStream, providing a cost-effective solution for the backfill process.
- Designed and executed a comprehensive SCD2 implementation for Salesforce Objects in Keboola.
- Optimized merge flows for large tables, reducing processing time significantly and increasing overall efficiency for datasets consisting solely of insert statements.
Data Engineer
Gauntlet Networks Inc
- Refactored the ETL packages written for lending protocols to modularize and make them scalable.
- Config-driven ETL design has been applied to current modules. With this new design, integrating new customers into the system became flexible and much easier.
- Tested and validated newly written ETL flows by comparing their output with production data.
Senior Data Engineer
Groupon
- Acted as part of the data ingestion team and was in charge of a replication flow of MySQL and Postgres data to HDFS, Hive, and Teradata through in-house developed ETL tools.
- Developed an audit package that compares record counts between source and target systems and sends the differences greater than a threshold to a dashboard.
- Added a feature to the in-house developed ETL tool to incrementally get data from Postgres sources.
- Contributed cloud migration of on-prem environments and services to GCP and AWS. Set up Dataproc clusters, configured jobs on Airflow, implemented audit scripts with Python on GCP, and configured hosts via Terraform on AWS.
Data Engineer
FIS Global (Worldpay)
- Served as a data engineer in the data integration team that mainly uses ODI in the new acquiring platform project.
- Made various ODI knowledge module customizations by writing Python codes to optimize workflows.
- Conducted performance tuning after data volumes increased due to migration projects by using SQL and PL/SQL.
Lead Data Warehouse Developer
Akbank
- Created three new data marts and analyzed the needs of business teams using Informatica.
- Increased the use of the ODS environment by improving validation jobs using Informatica and PL/SQL.
- Established ETL offloading for performance tuning using Hadoop and Spark.
- Continuously conducted performance tuning on ETL jobs using SQL, PL/SQL, and Informatica.
Senior ETL Developer
KKB
- Validated and integrated all credit card-related data from multiple banks in Turkey into the KKB system by using Informatica.
- Performed performance tuning on ETL jobs using SQL, PL/SQL, and Informatica.
- Designed and developed a map-based dashboard for reporting Corporate Score Query results by using OBIEE.
Data Warehouse Architect
Türkiye Sigorta
- Established an enterprise data warehouse and self-service BI environment for head office users using ODI and PL/SQL.
- Automatized regulatory reporting through a regulatory reporting data mart using OBIEE.
- Provided training on ODI and OBIEE to various departments in the company.
- Made customizations by writing Python codes to optimize an ETL workflow.
Experience
Optimus ETL Tool
Education
Bachelor of Science Degree in Computer Engineering
Ege University - Izmir, Turkey
Certifications
SQL (Advanced)
HackerRank
Oracle Cloud Infrastructure 2019 Certified Architect Professional
Oracle
PowerCenter Data Integration 10: Developer
Informatica
Skills
Libraries/APIs
PySpark
Tools
Apache Airflow, GitHub, PyCharm, Apache Sqoop, Shell, Oracle Business Intelligence Enterprise Edition 11g (OBIEE), Spark SQL, BigQuery, AWS Glue, Amazon Athena, Terraform, Packer, Informatica PowerCenter, Tableau, Grafana, Keboola
Languages
SQL, Stored Procedure, Python, Bash, Scala
Paradigms
ETL, OLAP, Business Intelligence (BI), Database Design, Database Development, Database-driven Web App Development
Platforms
Oracle Data Integrator (ODI), Oracle, Oracle Database, Visual Studio Code (VS Code), Amazon Web Services (AWS), Blockchain, Docker, Google Cloud Platform (GCP)
Storage
PL/SQL, Oracle PL/SQL, Databases, Data Pipelines, Oracle Cloud, OLTP, Database Management Systems (DBMS), Amazon S3 (AWS S3), PostgreSQL, MySQL, Teradata, Apache Hive, MongoDB
Frameworks
Hadoop, Spark, Apache Spark
Other
Informatica, Data Warehousing, Database Optimization, Query Optimization, Data Cleaning, Data Cleansing, Performance Tuning, ELT, Debugging, Data Engineering, Data Migration, Parquet, Data Analysis, ETL Testing, Data Manipulation, Data Quality, Data Warehouse Design, Data Profiling, Datasets, Query Composition, Data Analytics, Data Modeling, PL/SQL Tuning, AWS Cloud Architecture, Amazon RDS, Big Data, Dashboards, CSV, Google BigQuery, Data Matching, Cloud Architecture, Amazon Machine Images (AMI)
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring