Data Engineer
2020 - 2020Marketsonics LLC- Refactored existing ETL Python code, achieving 10x reduction in total lines of code vastly improving readability and maintainability.
- Designed and implemented custom cloud architecture for handling specific ETL workloads very efficiently and cheaply using Apache Airflow, AWS batch and Docker.
- Set up automatic alerts in case of any failure during periodic jobs.
Technologies: Amazon Web Services (AWS), Bash, PostgreSQL, Terraform, ETL, CSV, Slack App, Bitbucket, Apache Airflow, AWS, Docker, Python 3Full-stack Developer | Machine Learning Engineer
2019 - 2020inovex GmbH- Developed a fully functional image-captioning service including a web-page and highly available REST API with a team of four.
- Implemented and trained an image captioning model from scratch based on the latest research papers in the the field.
- Designed the micro-service architecture for usable image captioning and deployment on the Google Cloud Platform (GCP).
- Implemented continuous integration/development pipelines for all the micro-services using GitLab enterprise tools.
- Wrote a blog-post about project details including information about technologies as well as management methodologies.
- Established Google Cloud Budget alerts for automatically monitoring and notifying team members about possible budget overruns.
Technologies: gRPC, Terraform, Google Cloud Platform (GCP), Helm, Kubernetes, Docker, Vue.js, JavaScript, PyTorch, Flask, PythonTutor in the Master Course of Foundations in Data Engineering
2019 - 2020Technical University of Munich- Conducted tutorial sessions with students explaining the most important aspects of the lecture and answering questions.
- Held appointment study sessions for students who needed individual help with the lectures and assignments.
- Took part in grading assignments and final exams.
Technologies: Spark, Scala, C++, BashSenior Software Developer | Data Scientist
2016 - 2020Leavingstone- Developed a framework for creating and deploying dialog systems (chatbots) on Facebook Messenger.
- Implemented numerous chatbots, the best of which had more than a million interactions and a second-day retention rate of 20%.
- Created a graph-based web interface for easily assembling custom chatbots with only entering dialog texts and not a single line of code.
- Wrote a chatbot for helping citizens wrongly fined by the police in Georgia. It would query users about circumstances of the offence and then automatically generate personalized appeal PDF for submission to the court.
- Developed a platform of custom real-time data analytics for a retail chain with more than 250 stores throughout Tbilisi.
- Implemented a recommendation system for a large retail business. It would automatically generate special offers and gifts for loyal customers using machine learning tools.
- Created a web scraper for continuously gathering publicly available data about all the parking tickets written in Tbilisi.
- Designed and Implemented a data analytics web page about all the parking tickets in Tbilisi. It included a heatmap and other types of charts as well as textual comments with analysis.
- Built an API for guessing a person's nationality based on their first and last name, using deep natural language processing (Fast.ai).
- Built a REST API for transliterating from English to Georgian using Flask and SQL.
Technologies: Amazon Web Services (AWS), BigQuery, Google Cloud Platform (GCP), AWS, Flask, Django, Spark, Pandas, Kotlin, Scala, JavaScript, Java, SQL, PythonPython Developer
2019 - 2019Elasticiti Inc- Refactored the existing Apache Airflow project to remove code duplication and make it easily extensible.
- Examined existing ETL pipelines, tracked and fixed bugs.
- Implemented, tested and deployed a new ETL pipeline for handling daily updated raw client data.
- Created a detailed wiki markdown documentation about my work and other parts of the existing project.
Technologies: Snowflake, Markdown, Amazon Web Services (AWS), JSON, Apache Airflow, SQL, Requests, Pandas, PythonSenior Software Developer | Web Automation Engineer
2018 - 2018The Rundown- Developed a scraping tool for automatically gathering live data from various sports-betting websites.
- Implemented a REST API using Flask to make the sports-betting data easily accessible for other services.
- Built automated testing/integration tools for easy and painless software updates.
- Conducted daily stand-up meetings for all the developers to catch up with each other and plan the following day.
- Developed a REST API to automatically and instantly place bets on various sports-betting websites.
- Implemented an algorithm to gather all the available sports-betting data, find and place profitable bets.
Technologies: Amazon Web Services (AWS), Docker Compose, Docker, AWS, MySQL, Spring, Flask, Scrapy, Requests, HTTP, Selenium, Java, PythonSoftware/Web Scraping Engineer
2016 - 2018Freelance- Implemented a data aggregation framework that would collect, process and extract daily data about various online game stats in order to help the client (Jabre Capital Partners) with the stock market trading decisions.
- Developed a desktop GUI program for monitoring and automatically purchasing rare items in eCommerce shops when these items come in-stock. The websites were Amazon, Walmart, Best Buy, and The Source.
- Built a microframework in Python for writing auto-trader robots for cryptocurrencies using the Coinigy API.
- Wrote a Python program to use the Amazon Web Services API and automatically manage tags for all the resources.
- Developed a web crawler for collecting and storing discount coupon codes.
- Created a tool for exporting slides as JPEG images from Microsoft PowerPoint using Python, Unoconv, and Convert.
- Rewrote large numerical analysis project from Visual Basic to modern Python 3 with careful testing to guarantee the same output.
- Implemented and deployed a custom trading strategy on Python 3 and the Coinigy platform.
- Wrote more than 20 small web-scraping programs using Python.
Technologies: Amazon Web Services (AWS), PyQt 5, AWS, Spark, Scala, Selenium, SciPy, Scikit-learn, Pandas, Django, Scrapy, Python
Nika Dogonadze
Data Scientist and Developer in Tbilisi, Georgia
Member since November 4, 2017
Nika has over five years of experience working as a freelance developer, specializing in Python, web scraping, data engineering, and machine learning. He has a bachelor's degree in computer science and mathematics, together with a great deal of experience in scraping data from multiple resources such as websites, multiple proprietary file formats, and various types of databases. Nika is personable, communicates exceptionally well, and has worked with small-to-medium-sized teams.
Nika is now available for hire
Portfolio
- Marketsonics LLCAmazon Web Services (AWS), Bash, PostgreSQL, Terraform, ETL, CSV, Slack App...
- inovex GmbHgRPC, Terraform, Google Cloud Platform (GCP), Helm, Kubernetes, Docker...
- Technical University of MunichSpark, Scala, C++, Bash
Experience
- SQL 6 years
- Python 6 years
- Software Development 5 years
- Web Scraping 5 years
- Data Science 4 years
- Machine Learning 3 years
- Google Cloud Platform (GCP) 3 years
- Data Engineering 2 years
Availability
Unavailable
Preferred Environment
Jupyter Notebook, VS Code, PyCharm, IntelliJ IDEA, Windows, Linux
The most amazing...
...project I've created is a state-of-the-art face forgery detection model (available at https://github.com/Megatvini/DeepFaceForgeryDetection).
Employment
Experience
- Deep Face Forgery Detectionhttps://github.com/Megatvini/DeepFaceForgeryDetection
I developed a deep learning-based tool for automatically detecting human face forgeries in videos and single frames. I built and trained the model from scratch, based on theoretical insights from the latest research papers in the field. I tried multiple approaches from regular neural networks to LSTMs with 3D convolutional networks as the encoder.
A detailed description is available in the following paper:
• https://arxiv.org/abs/2004.11804 - Image Captioning Service (Web and API)https://www.inovex.de/blog/end-to-end-image-captioning/
I developed a microservice-based image captioning service with a team of four. I was involved in all parts of the projects from the initial design of what the services should be to implementing each of them separately.
The project was entirely developed with agile methodologies and my role was to oversee the whole development process as well as take part in actual coding/implementation
Skills
Languages
SQL, Python, Java, Kotlin, Python 3, Bash, JavaScript, C, Markdown, R, Scala, Snowflake, C++Frameworks
Selenium, Spark, Flask, Scrapy, Django REST Framework, Django, Apache Spark, gRPC, SpringLibraries/APIs
Beautiful Soup, PyMongo, Pandas, NumPy, Requests, Node.js, Setuptools, Scikit-learn, PyQt 5, Spark ML, Apiary API, PyTorch, Google Cloud API, Vue.js, PhantomJS, Django ORM, TensorFlow, Twitch.tv API, PyQt, SciPy, MatplotlibTools
Scraping Hub, GitHub, GitLab, Jupyter, JetBrains, GitLab CI/CD, Spark SQL, Tableau, Git, Apache Airflow, Google Kubernetes Engine (GKE), Terraform, BigQuery, IntelliJ IDEA, VS Code, Bitbucket, Helm, Docker Compose, Unoconv, Boto 3, Seaborn, PyCharm, MATLABParadigms
Data Science, ETL, REST, Unit Testing, Agile, TestingPlatforms
Jupyter Notebook, Docker, Google Cloud Platform (GCP), Spark Core, AWS EC2, AWS Lambda, Linux, Amazon Web Services (AWS), Kubernetes, Azure, ConvertKit, Linux CentOS 7, Android, Windows, Google Cloud SDKStorage
AWS S3, Databases, Google Cloud Storage, NoSQL, PostgreSQL 10.1, Redis, MySQL, MongoDB, Google Cloud, PostgreSQL, JSONOther
Scraping, Data Scraping, Screen Scraping, Store Scraping, Natural Language Processing (NLP), Site Bots, Bots, Networks, HTTP, Supervised Learning, Classification Algorithms, Classification, Predictive Learning, Algorithms, Clustering Algorithms, Statistics, Software Development, Big Data, Machine Vision, Web Scraping, APIs, Deep Learning, Kubernetes Operations (Kops), Google BigQuery, Architecture, Data Engineering, Serverless, API Applications, Parquet, AWS, Machine Learning, HTTPS, Unsupervised Learning, Regression, Text Classification, Heuristic & Exact Algorithms, Optimization Algorithms, Genetic Algorithms, Mathematics, Computer Science, Artificial Intelligence (AI), Machine Learning Automation, ETL Tools, ETL Development, Slack App, CSV, Google Cloud Functions
Education
- Master's degree in Data Engineering and Analytics2018 - 2020Technical University of Munich - Munich, Germany
- Nanodegree in Data Analytics2017 - 2017Udacity - Udacity.com
- Bachelor's degree in Computer Science2013 - 2017Free University of Tbilisi - Tbilisi, Georgia
Certifications
- Deep Learning SpecializationJUNE 2018 - PRESENTCoursera
- Data AnalystDECEMBER 2017 - PRESENTUdacity
- IELTSJANUARY 2017 - PRESENTBritish Council
