Software Developer
2018 - 2019Oyu Tolgoi LLC (via Toptal)- Built a data processing platform to process seismic events.
- Created a RESTful API to store and retrieve seismic data and files; also to trigger different processing pipelines.
- Used Kafka as a message bus between all modules.
- Implemented Redis as a cache to store data needed to accessed frequently by the pipeline.
- Built an admin UI by Django to administer configurations and saved objects.
Technologies: Python, Django RESTful, Kafka, Redis, MongoDB, KubernetesSenior Big Data Engineer
2017 - 2019Orange- Developed new use cases with big data technologies.
- Constructed new POCs for customers to build big data platforms over cloud environments.
- Implemented a new centralized Elasticsearch to collect metrics from all customers' servers.
- Designed and built multiple dashboards for systems monitoring use cases.
- Applied and deployed new changes and also fixed current incidents on big data platforms.
- Handled and optimized the performance of the big data platforms.
- Managed the Hadoop cluster with all included services.
Technologies: Hadoop, Spark, Elasticsearch, Cassandra, MongoDBDWH and Campaigns Senior Analyst
2014 - 2017Etisalat- Analyzed and segmented customer profiles.
- Added new customer attributes on a campaign management application.
- Developed new platforms and applications that interact with the customers with different channels.
- Built new ad hoc integrations between campaign management tools and new channels.
- Created jobs for real-time campaigns to target users based on specific events.
Technologies: Teradata, SQL, Java, Spring, IBM Streams, Campaign Management ToolsMIS Specialist
2013 - 2014ADIB- Designed and implemented new database models for reporting purposes.
- Developed extraction jobs and stored procedures.
- Implemented Business Objects universes and developed Business Objects reports.
- Developed custom Crystal Reports.
- Performed data transformation.
Technologies: Business Objects, Crystal Reports, SQL, Sybase, MS SQL ServerDWH Support Analyst
2012 - 2013Etisalat- Deployed and fixed issues for production ETL jobs, data mining, and analytic models.
- Developed new shell scripts for automatic monitoring and alarms for production issues.
Technologies: Teradata, Oracle, SQL, Datastage, Teradata Warehouse Miner, Unix Shell ScriptingSoftware Developer
2011 - 2012ITS- Developed new modules in core banking applications.
- Performed a full migration of the trade finance applications from Sybase to a SQL server.
- Implemented a full-service interface for a trade finance application.
- Developed custom reports using Crystal Reports.
Technologies: MS SQL Server, Oracle, Sybase, Java
Big Data Developer in New Cairo, Egypt
Member since May 13, 2016
Hanee' is a data expert who enjoys working on data analytics and segmentations in order to better target customers with campaigns. He is also an experienced Java developer who has built enterprise applications that interact with millions of customers daily. Hanee' also has some experience working with big data, Spark, and Python.
Hanee' is now available for hire
Portfolio
- Oyu Tolgoi LLC (via Toptal)Python, Django RESTful, Kafka, Redis, MongoDB, Kubernetes
- OrangeHadoop, Spark, Elasticsearch, Cassandra, MongoDB
- EtisalatTeradata, SQL, Java, Spring, IBM Streams, Campaign Management Tools
Experience
- SQL, 5 years
- Python, 3 years
- Big Data, 2 years
- Apache Spark, 2 years
- Apache Kafka, 1 year
- Machine Learning, 1 year
- PostgreSQL, 1 year
- MongoDB, 1 year
Availability
Part-time
Preferred Environment
OS X, Linux, Git
The most amazing...
...project that I've implemented is a platform that optimized campaigns scripts by analyzing user responses to identify the best way to interact with the users.
Employment
Experience
- Certified CCA Spark and Hadoop Developer (CCA175) (Other amazing things)http://certification.cloudera.com/verify/
I gained a certification from Cloudera.
License No: 100-019-596. - Big Data Development | Mastery Award for Professionals 2016 (Other amazing things)https://www.youracclaim.com/badges/da6c7070-8fde-4799-b04e-f9d8719a49a3/linked_in_profile
I won an award from IBM.
- Big Data Specialist with IBM BigInsights V2.1 Certificate (Other amazing things)
I gained the certificate IBM Big Data Specialist in March 2016 with license # 0717-1458-8215-5644.
- Introduction to Big Data Certificate (Other amazing things)https://www.coursera.org/account/accomplishments/certificate/CPH7HZ6TDEZN
I completed this Coursera course from the University of California, San Diego.
- Hadoop Platform and Application Framework Certificate (Other amazing things)https://www.coursera.org/account/accomplishments/certificate/Y6QNGTJMQFVV
I completed this Coursera course from the University of California, San Diego.
- Apache Spark Streaming Tutorial: Identifying Trending Twitter Hashtags (Publication)Social networks are among the biggest sources of data today, and this means they are an extremely valuable asset for marketers, big data specialists, and even individual users like journalists and other professionals. Harnessing the potential of real-time Twitter data is also useful in many time-sensitive business processes. In this article, Toptal Freelance Software Engineer Hanee' Medhat explains how you can build a simple Python application to leverage the power of Apache Spark, and then use it to read and process tweets to identify trending hashtags.
Skills
Languages
SQL, Java, Python, C++Frameworks
Apache Spark, SpringTools
Cloudera, Grafana, Apache Impala, Apache Sqoop, Apache Avro, Kibana, Qlik Sense, Tableau, IBM Infosphere (Datastage), Crystal ReportsPlatforms
Apache Kafka, Hortonworks Data Platform (HDP), Unix, OracleStorage
Teradata, Apache Hive, PostgreSQL, MongoDB, MySQL, HBase, Sybase, Elasticsearch, Cassandra, Datastage, Microsoft SQL ServerOther
Big Data, Data Warehousing, Aprimo, Parquet, Machine Learning, SAP BusinessObjects (BO), Prometheus, Apache FlumeLibraries/APIs
Pandas, NumPy, D3.js, Charts.jsParadigms
Business Intelligence (BI)
Education
- Diploma degree in Business Intelligence and Software Development2010 - 2011Information Technology Institute - Cairo, Egypt
- Bachelor of Engineering degree in Computer Engineering2005 - 2010Benha University - Banha, Egypt
Certifications
- CCA Spark and Hadoop Developer CCA175DECEMBER 2017 - DECEMBER 2019Cloudera
