Adel Abu Hashim
Verified Expert in Engineering
Software Developer
Riyadh, Riyadh Province, Saudi Arabia
Toptal member since April 8, 2024
Adel is a seasoned software developer specializing in data management, ETL, and architecture. He has a proven track record of working in Python and SQL to transform data challenges into success stories. With several Udacity nano degrees in data engineering and machine learning, Adel is an expert in data theory and practice.
Portfolio
Experience
- Windows - 10 years
- Python 3 - 5 years
- SQL - 5 years
- Pandas - 3 years
- ETL - 3 years
- Apache Airflow - 2 years
- DataHub - 2 years
- Redshift - 1 year
Availability
Preferred Environment
Windows, Linux, MacOS, PyCharm, Terminal, Visual Studio Code (VS Code), SQL, Python
The most amazing...
...project I've been a part of is a metadata centralization that facilitated cross-technology integration and enhanced data accessibility for 100+ engineers.
Work Experience
Senior Data Engineer
Giza Systems
- Designed and implemented an automated data deletion module, ensuring offloaded data is removed only after passing quality checks, improving data integrity, and reducing manual effort.
- Led a deep-dive analysis to identify offloadable tables, map dependencies, assess business impact, and align with all affected users to ensure a seamless transition without disrupting operations.
- Enhanced system efficiency and accessibility by enabling a single access layer for data retrieval across multiple platforms, streamlining workflows for analytics and reporting teams.
- Optimized data storage and reduced costs by offloading terabytes of data from the data warehouse to the data lake, implementing a TIBCO and Trino-based data federation layer, and cutting teradata storage by over 100TB.
Data Engineer
Paymob
- Migrated millions of records from Paxstore and Gonisight APIs, eliminating Google Maps subscriptions.
- Automated data pipelines using ETL/reverse ETL for 10+ projects, streamlining data flow and improving efficiency.
- Optimized Redshift cluster utilization with big data solutions (Spark, Hive, S3, Presto), reducing costs by 20%.
- Enhanced data retrieval speed by 2x for business and data science teams through data profiling and model optimization.
Big Data Engineer
Etisalat Egypt
- Centralized diverse metadata in DataHub, facilitating seamless cross-technology integration and enhancing data accessibility for 100+ engineers.
- Developed a Data Quality Engine with KPIs using Python, reducing data errors by 50% and improving data reliability for analysis.
- Automated data migration tasks with Apache Airflow, achieving a 10x improvement in efficiency compared to manual processes.
- Ingested, stored, processed, and analyzed hundreds of terabytes of data for various projects.
- Engineered and deployed data pipelines using Python and SQL, saving the team 100+ hours per month in data preparation.
- Analyzed data findings and provided actionable insights and recommendations to drive project success and optimize outcomes for stakeholders.
Physics and Mathematics Teacher
Town School
- Helped students achieve high grades through structured lessons and problem-solving techniques.
- Developed personalized learning strategies that significantly improved students' understanding and performance.
- Taught over 100 students in mathematics and physics, covering topics from basic to advanced levels.
Experience
Data Warehouse for Sparkify
https://github.com/adelabuhashim/DataWarehouseAs a data engineer, this project involved building an ETL pipeline that extracts data from Amazon S3, stages it in Redshift, and transforms data into a set of dimensional tables for analytics team to continue finding insights into what songs their users are listening to. The project also involved testing the database and ETL pipeline by running SQL queries.
Education
Bachelor's Degree in Computer Engineering
Zagazig University - Zagazig, Egypt
Certifications
DAG Authoring for Apache Airflow
Astronomer
Data Architect
Udacity
Data Engineering Nanodegree
Udacity
Skills
Libraries/APIs
Pandas, PySpark
Tools
Apache Airflow, DataHub, PyCharm, Terminal, Impala, Cloudera, AWS CLI, AWS IAM, AWS Glue
Languages
Python 3, SQL, Python
Paradigms
ETL, OLAP
Platforms
Windows, Visual Studio Code (VS Code), Linux, Amazon Web Services (AWS), MacOS
Frameworks
Spark, Hadoop, Presto
Storage
Databases, Redshift, Apache Hive, HDFS, PostgreSQL, Amazon S3 (AWS S3), OLTP, Data Lakes, Teradata, SQL Stored Procedures
Other
Cloud, AWS Database Migration Service (DMS), MDM, System Administration, Software Engineering, Computer Networking, Computer Engineering, Designing Data Systems, Data Governance, Data Modeling, Apache Cassandra, Normalization, Data Warehousing, Big Data, Data Transformation, Data Lineage, Data Architecture, MinIO, Data Analysis, Mathematics, Physics, IT Service Management (ITSM)
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring