Publication
Using an LLM API As an Intelligent Virtual Assistant for Python Development
https://www.toptal.com/developers/openai/create-your-own-ai-assistant
Tarek is currently unavailable
Tarek Mohamed Mehrez
Verified Expert in Engineering
Data Engineering Developer
Amsterdam, Netherlands
Toptal member since September 23, 2021
Bio
Tarek is an EM/Architect/SWE with experience building tech products from the bottom up. He specializes in software architecture, DevOps, back-end development, data engineering, and production-ready machine learning components build. Tarek believes in bringing strong business values to the table, with technology being a tool, not an end goal.
Portfolio
Miro
Kotlin, Java, Amazon Web Services (AWS), Kubernetes, Prometheus, Grafana...
Klarna
Python, Go, Apache Kafka, Amazon Web Services (AWS), DevOps, Architecture...
Thndr
Python, Kubernetes, Google Cloud Platform (GCP), Amazon Web Services (AWS)...
Experience
- Python - 10 years
- Natural Language Processing (NLP) - 6 years
- Kubernetes - 6 years
- DevOps - 6 years
- Generative Pre-trained Transformers (GPT) - 6 years
- Data Engineering - 6 years
- GitLab CI/CD - 4 years
- Leadership - 3 years
Preferred Environment
Python, Amazon Web Services (AWS), Google Cloud Platform (GCP), Back-end, Data Engineering, DevOps, People Management, Microservices, AI Programming, Chatbots, OpenAI, AI Virtual Assistant, LlamaIndex, Web Scraping, Selenium, Scrapy, Software Engineering, Python 3, Python 2, ChatGPT
The most amazing...
...thing I've done is leading teams that delivered exceptional value while collaborating with amazing talent.
Work Experience
Engineering Manager
2023 - 2024
Miro
- Overhauled the team's delivery process, from product ideation to technical execution. Created the process to enable cross-functional collaboration.
- Handled and currently working on designing the observability process, including metrics, logging, and reporting for back- and front-end metrics while creating a new on-call and incident management routine for teams.
- Redesigned parts of the email and notifications delivery systems alongside the company's architects.
Technologies: Kotlin, Java, Amazon Web Services (AWS), Kubernetes, Prometheus, Grafana, Sentry, Planning, Architecture, Scrum, Agile, Data Engineering, Monitoring, Amazon RDS, PostgreSQL, GitLab CI/CD, DevOps, Leadership, People Management, Apache Flink, Amazon Kinesis, Back-end, Spring, API Design, Docker, OpenAI GPT-3 API, OpenAI GPT-4 API, Data Pipelines, Solution Architecture, Technical Leadership, SQL, REST APIs, ChatGPT API, Databases, Web Servers, Mobile, Sockets, Product Management, Swagger, API Development, Back-end Development, Code Review, Debugging, Software as a Service (SaaS), Generative Artificial Intelligence (GenAI), OpenAI API, Observability Tools, Metrics, Logging, Docker Compose, Automation, Event-driven Architecture, SaaS, Queue Management, Real-time Data, Real-time Systems, Integration, Python, Python 3, Python 2, Design Patterns
Engineering Manager
2021 - 2022
Klarna
- Built a tech team from scratch. This involved hiring developers and external consultants, participating in the interviewing process, and distributing the skillset required in the team accordingly.
- Built a scalable monitoring solution that monitors all business activity, connecting event streams from all products, and transforming them into detected anomalies and alerts in real-time by notifying the correct stakeholders.
- Expanded on the engineering culture within the company with efforts in internal communities and the official blog.
- Collaborated with multiple stakeholders on adding these analytics and monitoring systems to multiple data streams to help reduce costs and losses across the board.
Technologies: Python, Go, Apache Kafka, Amazon Web Services (AWS), DevOps, Architecture, Apache Flink, Amazon Kinesis, Kubernetes, Amazon RDS, PostgreSQL, Data Engineering, Leadership, People Management, Redshift, Java, Prometheus, Grafana, Sentry, Planning, Scrum, Agile, Monitoring, Back-end, FastAPI, Flask, Rockset, API Design, Machine Learning Operations (MLOps), Microservices Architecture, Docker, ETL, Amazon Athena, AWS Lambda, AWS Glue, Data Pipelines, Solution Architecture, Technical Leadership, SQL, NoSQL, Scalable Vector Databases, GitLab, REST APIs, Databases, Web Servers, API Integration, Vector Databases, Product Management, Swagger, Payment APIs, API Development, Back-end Development, Code Review, Debugging, Credit Systems, Software as a Service (SaaS), Transactions, Observability Tools, Metrics, Logging, eCommerce, Docker Compose, SQLAlchemy, Automation, Django, Queue Management, Real-time Data, Real-time Systems, Algorithms, Integration, Python 3, Python 2, Design Patterns
CTO
2019 - 2021
Thndr
- Built a team of software developers that started the company and built a full-blown app that covers trading in the Egyptian stock market with 100,000+ users.
- Led the team to support trading in multiple asset classes for investment, including stocks and mutual funds.
- Participated and led most of the major tech decisions of building the entire stack bottom up.
Technologies: Python, Kubernetes, Google Cloud Platform (GCP), Amazon Web Services (AWS), RabbitMQ, Redis, Amazon RDS, PostgreSQL, Metabase, Keycloak, Vault, GitLab CI/CD, DevOps, APIs, CTO, Stock Market, Django REST Framework, Django, Data Engineering, Leadership, People Management, Redshift, Architecture, Prometheus, Grafana, Sentry, Planning, Scrum, Agile, Monitoring, Back-end, FastAPI, Flask, API Design, Machine Learning Operations (MLOps), Microservices Architecture, Docker, ETL, AWS Lambda, Data Pipelines, Solution Architecture, Technical Leadership, SQL, NoSQL, Data Extraction, GitLab, REST APIs, Databases, Web Servers, Scraping, Trading, Backtesting Trading Strategies, Algorithmic Trading, Mobile, API Integration, Sockets, Product Management, Swagger, Payment APIs, API Development, Back-end Development, Code Review, Debugging, Transactions, Firebase, Cloud Storage, Observability Tools, Metrics, Logging, Alembic, Docker Compose, SQLAlchemy, Automation, Stock Analysis, Stock Trading, Trading Systems, Event-driven Architecture, Queue Management, ZeroMQ, Algorithms, Integration, Python 3, Python 2, Design Patterns
Machine Learning Engineer
2018 - 2019
Aigent
- Built an on-demand machine learning infrastructure for data scientists.
- Utilized Kubernetes and its scheduler to create an environment where data scientists can collaborate and build their models.
- Supported the data engineering team with technical decisions on building the data platform for analytics.
Technologies: Python, Kubernetes, Apache Airflow, TensorFlow, Keras, DevOps, Data Engineering, GitLab CI/CD, Architecture, Prometheus, Grafana, Planning, Scrum, Agile, Monitoring, Back-end, Flask, Machine Learning Operations (MLOps), Microservices Architecture, Docker, Artificial Intelligence (AI), AI Programming, ETL, SQL, NoSQL, Data Extraction, AI Chatbots, Retrieval-augmented Generation (RAG), GitLab, REST APIs, Databases, Web Servers, Scraping, API Integration, Vector Databases, Swagger, API Development, Code Review, Debugging, Observability Tools, Metrics, Logging, Docker Compose, SQLAlchemy, Automation, Hugging Face, Integration, SpaCy, Named-entity Recognition (NER), Python 3, Python 2
Research Engineer
2016 - 2018
Textkernel
- Moved a big part of the Perl monolith to the Python-based microservices running on production. I rearchitected those bits and built the surrounding base infrastructure to run services on Kubernetes.
- Built an infrastructure to serve machine learning models on Kubernetes behind Python services.
- Built a workflow to train and serve models using Kubernetes, utilizing its jobs and Dask (distributed pandas version). Also gave a talk on the topic in PyData Amsterdam 2018.
Technologies: Python, TensorFlow, TensorFlow Deep Learning Library (TFLearn), Keras, Theano, Flask, Prometheus, Grafana, ELK (Elastic Stack), Kubernetes, Jenkins, GitLab CI/CD, Perl, Java, Spring, Distributed Systems, Microservices, Microservices Architecture, Pandas, Dask, Docker, Artificial Intelligence (AI), AI Programming, SQL, NoSQL, Data Extraction, AI Chatbots, GitLab, REST APIs, Databases, Web Servers, Scraping, Optical Character Recognition (OCR), API Development, Code Review, Debugging, Observability Tools, Metrics, Logging, Docker Compose, Automation, Integration, SpaCy, Named-entity Recognition (NER), Python 3, Python 2
Experience
Knowledge Graph Generation Using AI Techniques
Using various AI techniques, the task was to construct a knowledge graph of entities, entity clusters, and topics when given a list of documents in a specific domain. Then, this graph would be used to detect signals given specific domain expertise provided by a subject matter expert.
Thndr - Investment Trading Platform
https://thndr.app/A full-blown microservices architecture built on top of Fast API.
Hosted on Kubernetes on top of AWS.
Features include:
• Trading multiple asset classes
• Internal subscription system
• Internal admin system for operations
Hosted on Kubernetes on top of AWS.
Features include:
• Trading multiple asset classes
• Internal subscription system
• Internal admin system for operations
Real-time Business Analytics Performance and Reporting
https://www.klarna.com/A real-time platform that monitors tens of millions of metrics and detects anomalies in any of them within less than a minute. This system was built to monitor high cardinality data of merchant integrations for a global fintech. I developed the team, architected the system, chose the stack, and worked with the team to complete it by managing the planning process, roadmap, and execution. I also worked heavily as an IC on the ingestion and alerting components.
Internal Data Science Platform
A platform that enables data science to interrogate data, run experiments, and machine learning research at scale from a single interface. I built the project by connecting multiple data sources, Apache Spark, distributed TensorFlow, Kubernetes-based infrastructure, and Jupyter notebook UI. This enabled more than ten internal data scientists to worry less about infrastructure and focus on data science work. I also tuned the Kubernetes scheduler by writing a component that integrates GPUs into the cluster. I gave a talk at a meetup on the topic.
Education
2013 - 2016
Master of Science Degree in Machine Learning
University of Stuttgart - Stuttgart, Germany
2009 - 2013
Bachelor's Degree in Computer Science
German University in Cairo - Cairo, Egypt
Certifications
DECEMBER 2020 - PRESENT
Leadership Principles
Harvard Business School Online
Skills
Libraries/APIs
Pandas, Dask, REST APIs, API Development, Slack API, Spark ML, Theano, Sockets, OpenAI API, SQLAlchemy, SpaCy, TensorFlow, Keras, TensorFlow Deep Learning Library (TFLearn), ZeroMQ
Tools
Jenkins, GitLab CI/CD, Grafana, Sentry, Amazon Elastic Container Service (ECS), ELK (Elastic Stack), GitLab, Observability Tools, Logging, Docker Compose, Named-entity Recognition (NER), Apache Airflow, Amazon Athena, AWS Glue, ChatGPT, RabbitMQ, Keycloak, Vault, Flink, Kafka Streams, Spark SQL
Languages
Python, SQL, Python 3, Python 2, Go, Kotlin, Java, Perl
Frameworks
Django, Swagger, Spark, Django REST Framework, Flask, Scrapy, Selenium, Alembic, Spring, LlamaIndex
Paradigms
DevOps, Scrum, Agile, Microservices, Microservices Architecture, ETL, Automation, Event-driven Architecture, Real-time Systems, Design Patterns
Platforms
Kubernetes, Amazon Web Services (AWS), Jupyter Notebook, Docker, Google Cloud Platform (GCP), AWS Lambda, Mobile, Firebase, Apache Kafka, Apache Flink
Storage
PostgreSQL, Amazon S3 (AWS S3), Data Pipelines, NoSQL, Redis, Redshift, Databases
Industry Expertise
Trading Systems
Other
Natural Language Processing (NLP), Data Engineering, Amazon RDS, APIs, Architecture, Prometheus, Planning, Monitoring, Back-end, FastAPI, API Design, Machine Learning Operations (MLOps), Generative Pre-trained Transformers (GPT), AI Programming, Solution Architecture, Technical Leadership, Scraping, API Integration, Back-end Development, Code Review, Debugging, Metrics, Software Engineering, Integration, Machine Learning, Leadership, People Management, CTO, Stock Market, Rockset, Slackbot, Redis Clusters, Kubernetes Operations (kOps), MinIO, MLflow, Artificial Intelligence (AI), Web Scraping, OpenAI GPT-4 API, Data Extraction, AI Chatbots, Chatbots, OpenAI, AI Virtual Assistant, Retrieval-augmented Generation (RAG), Scalable Vector Databases, ChatGPT API, Web Servers, Generative Artificial Intelligence (GenAI), LangChain, Product Management, Payment APIs, Credit Systems, Software as a Service (SaaS), Transactions, Cloud Storage, eCommerce, Stock Trading, SaaS, Queue Management, Real-time Data, Algorithms, Metabase, Amazon Kinesis, Distributed Systems, OpenAI GPT-3 API, Trading, Backtesting Trading Strategies, Algorithmic Trading, Large Language Models (LLMs), Knowledge Graphs, Vector Databases, Optical Character Recognition (OCR), Stock Analysis, Hugging Face
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring