Big Data Architect2019 - PRESENTVodafone
Technologies: Spark, Python, GeoPandas, Airflow, BigQuery and Tableau
- Design data pipelines for data sources.
- Develop and implement ETL jobs.
- Develop Transformation jobs using Spark.
- Develop analytical jobs using PySpark.
- Develop dashboards for business using Tableau.
Python Developer2018 - 2019Rio Tinto (via Toptal)
Technologies: Python, Django RESTful, Kafka, Redis, MongoDB, Kubernetes
- Built a data processing platform to process seismic events.
- Created a RESTful API to store and retrieve seismic data and files; also to trigger different processing pipelines.
- Used Kafka as a message bus between all modules.
- Implemented Redis as a cache to store data needed to accessed frequently by the pipeline.
- Built an admin UI by Django to administer configurations and saved objects.
Senior Big Data Engineer2017 - 2019Orange
Technologies: Hadoop, Spark, Elasticsearch, Cassandra, MongoDB, Tableau
- Developed new use cases with big data technologies.
- Constructed new POCs for customers to build big data platforms over cloud environments.
- Implemented a new centralized Elasticsearch to collect metrics from all customers' servers.
- Designed and built multiple dashboards for systems monitoring use cases.
- Applied and deployed new changes and also fixed current incidents on big data platforms.
- Handled and optimized the performance of the big data platforms.
- Managed the Hadoop cluster with all included services.
- Developed transformation jobs using spark.
DWH and Campaigns Senior Analyst2014 - 2017Etisalat
Technologies: Teradata, SQL, Java, Spring, IBM Streams, Campaign Management Tools
- Analyzed and segmented customer profiles.
- Added new customer attributes on a campaign management application.
- Developed new platforms and applications that interact with the customers with different channels.
- Built new ad hoc integrations between campaign management tools and new channels.
- Created jobs for real-time campaigns to target users based on specific events.
MIS Specialist2013 - 2014ADIB
Technologies: Business Objects, Crystal Reports, SQL, Sybase, MS SQL Server
- Designed and implemented new database models for reporting purposes.
- Developed extraction jobs and stored procedures.
- Implemented Business Objects universes and developed Business Objects reports.
- Developed custom Crystal Reports.
- Performed data transformation.
DWH Support Analyst2012 - 2013Etisalat
Technologies: Teradata, Oracle, SQL, Datastage, Teradata Warehouse Miner, Unix Shell Scripting
- Deployed and fixed issues for production ETL jobs, data mining, and analytic models.
- Developed new shell scripts for automatic monitoring and alarms for production issues.
Software Developer2011 - 2012ITS
Technologies: MS SQL Server, Oracle, Sybase, Java
- Developed new modules in core banking applications.
- Performed a full migration of the trade finance applications from Sybase to a SQL server.
- Implemented a full-service interface for a trade finance application.
- Developed custom reports using Crystal Reports.