Ars Potapov
Big Data Developer
Location
Almaty, Almaty Province, Kazakhstan
Toptal Member Since
August 20, 2016
Ars is a senior back-end engineer specializing in data and high load with more than ten years in web development. He is a Python expert, proactive and self-sufficient, competent, troubleshooter and problem solver, great communicator, team player, project manager, and team leader.
Ars is available for hire
Hire ArsPortfolio
PyPie
Marketing Automation, Vue, MySQL, MongoDB, Flask, Django, JavaScript, Python...
LQFI
Amazon Elastic Container Service (Amazon ECS), React, TypeScript, Node.js, Rust...
Granicus
Amazon Web Services (AWS), Docker, Elasticsearch, PostgreSQL, PostGIS, Python...
Experience
SQL - 15 yearsDjango - 10 yearsPython - 10 yearsAmazon Web Services (AWS) - 10 yearsNumPy - 9 yearsRedis - 9 yearsBig Data - 7 yearsElasticsearch - 6 yearsLocation
Availability
Part-time
Preferred Environment
PyCharm, Slack, GitHub, MacOS
The most amazing...
...things in the nearest technological future are connected with machine learning. That's why I use every chance to learn and play with it.
Work Experience
2017 - PRESENT
Lead Developer
PyPie
- Built an algorithm for the auto-optimization of internet advertising campaigns, which maximizes their performance by finding and blocking traffic sources and platforms that do not convert well enough.
- Architected and implemented ETL for a mobile advertising affiliate network. I used proprietary technologies for predicting the likelihood of conversion based on device data.
- Developed a bot detection feature that redirected bots from website content to other destinations—protecting content from crawling.
- Implemented email marketing automation and a CRM integration, using SparkPost API and Zoho CRM.
- Consulted clients in the tech area, architected solutions, managed an agile dev team. Participated in a lot of planning, communication, brainstorming, and architecting. Tracked team's KPIs and managed the goals.
Technologies: Marketing Automation, Vue, MySQL, MongoDB, Flask, Django, JavaScript, Python, Project Management, Agile, Git, Serverless, Pandas, NumPy, Large-scale Web Crawlers, Web Crawlers, Web Scraping, Scraping, Databases, Data Engineering, Data Modeling, Celery, Amazon Web Services (AWS), Microservices, Pytest, REST APIs, Node.js, Team Leadership, API Development, CTO, APIs, Product Development, Software Architecture, Technical Leadership
2022 - 2022
Senior Full-Stack Developer
LQFI
- Developed algorithm trading strategies for Binance, Kraken, and Huobi.
- Integrated cold wallets with the platform via Web3.
- Extended the internal framework and added multiple API integrations.
Technologies: Amazon Elastic Container Service (Amazon ECS), React, TypeScript, Node.js, Rust, Solidity, MongoDB, API Development, Fintech, APIs
2019 - 2022
Senior Back-end Developer
Granicus
- Developed platform API for short-term rental platforms to comply with the city of Los Angeles laws. This had a significant effect on cleaning fraudulent/unregistered listings from Airbnb and other platforms in LA.
- Created an API for user file uploads with a focus on security and. FedRAMP guidelines. This feature allowed encryption, very granular access control, and tight security policies to be implemented.
- Developed part of the platform allowing property management companies to renew their rental permits, report and pay taxes in bulk rather than individually.
- Built a basement for GraphQL back end for a new dashboard, which was highly modular and flexible and used a schema-first approach. This allowed the back-end team to extend the features quickly and kept the front-end team less dependent on back-end releases.
Technologies: Amazon Web Services (AWS), Docker, Elasticsearch, PostgreSQL, PostGIS, Python, Asyncio, GraphQL, Flask, RQ, Serverless, AWS Lambda, Amazon Elastic Container Service (Amazon ECS), SMS, Voice, Transactional Emails, Billing, Stripe Payments, GitHub, Pandas, NumPy, SQLAlchemy, Large-scale Web Crawlers, Web Crawlers, Scrapy, Scraping Hub, Web Scraping, Scraping, Databases, Data Engineering, Data Modeling, Git, Microservices, Pytest, Jira, REST APIs, API Development, APIs
2018 - 2022
Tech Consultant
CORRECTic
- Consulted clients regarding algorithms, performance issues, tech stack, and solution architecture.
- Researched when required and played a crucial role in building a long-term strategy, planning sprints, grooming the task backlog, and preparing the tickets.
- Managed project and agile development team. Done hundreds of code reviews. Mentored and onboarded new developers. Tracked team's KPIs and goals.
- Handled all operation work and configured the cloud infrastructure from scratch.
Technologies: Amazon Web Services (AWS), MongoDB, Python 3, Celery, Agile, GitLab, CI/CD Pipelines, Vue, NumPy, Pandas, Data Analysis, Machine Learning, Databases, Data Engineering, Data Modeling, Scalability, Git, Algorithms, Pytest, REST APIs, Team Leadership, API Development, CTO, APIs, Product Development, Software Architecture, Technical Leadership
2015 - 2017
Senior Back-end Developer
branded.me
- Developed social networking features (follows, likes, and feeds) to be almost linearly scalable.
- Spotted and successfully coped with several bottlenecks in the back-end API code and infrastructure; made huge speed and robustness improvement.
- Wrote an algorithm to match users together based on contact lists users upload (a social networking feature).
- Performed email service integration, including dealing with bounces, unsubscribes, campaigns, and conversion funnel (marketing-specific experience).
- Integrated the billing, which includes work with user's accounts, transactions, adjustments, and recurrent payment plans (experience with user's money).
- Applied machine learning (NLP, clustering, neural networks, classification) to match users with open job positions based on their profile and job description. Also developed an algorithm to predict required skills for a job based on its description.
Technologies: Amazon Web Services (AWS), Celery, Flask, Redis, MongoDB, Data Analysis, Marketing Automation, Generative Pre-trained Transformers (GPT), Natural Language Processing (NLP), GPT, Machine Learning, Python, Web Scraping, Scraping, Databases, Data Engineering, Data Modeling, Scalability, Git, Algorithms, Microservices, Pytest, REST APIs, API Development, APIs
2013 - 2015
Senior Python Developer
Ajillion by Crossrider
- Fixed a system to scale linearly by profiling and eliminating critical bottlenecks, and dramatically reducing IO usage on each cluster node.
- Implemented a global lock feature on top of a Redis DB. Whenever it should be guaranteed that the shortcode section has exclusive access to some portion of data, it just acquires a lock, and other instances won't be able to reach it until release.
- Dramatically reduced latency by adding memorization on top of a local process memory and 2-level caching (local and remote Redis).
- Integrated with Google Ads, MobFox, and other RTB partners (real-time bidding).
- Created a special filtering layer on the level of Nginx. Lua scripts apply all the filtering efficiently by dropping not-useful connections very early, even before it gets to the Python back end.
Technologies: Amazon Web Services (AWS), High-load, Vertica, Low Latency, Big Data, Redis, Lua, MongoDB, MySQL, Celery, Django, Python, Databases, Data Engineering, Data Modeling, Scalability, Git, Algorithms, REST APIs, API Development, APIs, Software Architecture
2012 - 2013
Senior Python Developer | Team Lead
Blackcloud BSG
- Developed a platform for the salespeople where they could schedule meetings, record their progress, and where they can self-educate to sell better and increase their KPI.
- Managed a team of developers, discussed features with the client, planned sprints, and then distributed tasks to developers, did showcases, and gathered feedback. Used Agile methodology.
- Developed a data-set preparation layer for a cloud machine learning platform: the data was accepted in different formats, and it has to be unpacked, parsed, shuffled, normalized, split onto parts, and fed into the machine learning workers' queue.
- Created a data set management system: a user can upload his data sets, review them, view some statistics, configure how to process them, download and remove them. It then passes it into the machine learning session OFC.
Technologies: Bootstrap, JavaScript, Amazon S3 (AWS S3), Machine Learning, Celery, Django, Python, Databases, Git, Amazon Web Services (AWS), Algorithms, Jira, REST APIs, Team Leadership, API Development, CTO, APIs, Product Development, Technical Leadership
2010 - 2013
Senior Python Developer
CTS Games
- Implemented an anti-cheat system to detect hackers and cheaters; ban them or not let them get any benefits from using cheats. Utilizes a lot of math, statistics, and data analysis.
- Developed a 3D-shooting feature (a game mechanic when a player shoots a monster or another player). Required math, statistics, and integration with other modules such as items and the anti-cheat system.
- Created the first version of Creatures AI, which included configurable automation of creatures/monster behavior: spawning, movement on the map, aggression against players or even other creatures, and more.
- Developed a screen for player creation, where new players can change the appearance of their model: gender, face, skin color, initial uniform, and outfit.
Technologies: BigWorld, MySQL, C++, Python, Pandas, Data Analysis
Experience
Push To Notion
https://ptn.potapov.devI'm a big fan of Notion; I use it for tracking and documenting everything: ideas, code and shell snippets, plans, reminders, and, obviously, to-dos. Sometimes I need a quick-and-easy way to add something to my to-do list, but opening the Notion app and finding the right page isn't convenient. Often, it means losing momentum or another important context; sometimes, I'm on the go or doing something with my hands. So I started thinking how nice it would be to push things to Notion from Siri, Alfred, and maybe even Slack and Telegram. So I built a tool doing precisely that.
And you can try it or even check its source code on Github: https://github.com/muzhig/push-to-notion.
And you can try it or even check its source code on Github: https://github.com/muzhig/push-to-notion.
Telegram Bot: @PageScreenshotBot
https://t.me/PageScreenshotBotSend a command to the bot with the URL: /screenshot https://example.com. It will reply with a full-height screenshot of the webpage. Bot utilizes Puppeteer to control a containerized Chrome instance. This works on top of AWS Lambda.
Telegram Bot: @scan_driver_license_bot
https://t.me/scan_driver_license_botSend a picture of an ID card or driver's license (US) - the bot will reply with data parsed from it. The bot doesn't store the picture anywhere, purely stateless service. Works on AWS Lambda utilizes Amazon's computer vision API.
Telegram Bot @detect_mask_on_selfie_bot
https://t.me/detect_mask_on_selfie_botSend a selfie or picture with one or several persons - the bot will detect if masks are present and respond to the results. Service is serverless, based on AWS Lambda, uses Amazon's Computer Vision API.
Skills
Languages
Python, SQL, GraphQL, JavaScript, Java, C, Lua, C#, C++, Python 3, TypeScript, Rust, Solidity
Frameworks
Django, Flask, Scrapy, Bootstrap, OAuth 2, Serverless Framework
Libraries/APIs
NumPy, Pandas, REST APIs, API Development, Matplotlib, jQuery, SQLAlchemy, Node.js, Twilio API, Twitter API, Facebook API, VK API, Vuex, Spark Streaming, Vue, TensorFlow, Asyncio, RQ, Puppeteer, Telegram Bot API, React
Tools
Git, Celery, Jira, Scraping Hub, Pytest, PyCharm, Jenkins, Kafka Streams, NGINX, Slack, GitHub, GitLab, Amazon Elastic Container Service (Amazon ECS)
Paradigms
Agile, Load Testing, Microservices, REST
Storage
Redis, Databases, Elasticsearch, MongoDB, PostgreSQL, MySQL, Amazon S3 (AWS S3), Vertica, MySQL Clustering, Cassandra, PostGIS, Amazon DynamoDB
Other
APIs, Scalability, Data Engineering, Data Modeling, Natural Language Processing (NLP), Algorithms, Big Data, Data Structures, Applied Mathematics, Optimization, Scraping, Web Scraping, Large-scale Web Crawlers, Web Crawlers, Team Leadership, CTO, Product Development, Software Architecture, Technical Leadership, GPT, Generative Pre-trained Transformers (GPT), Low Latency, High-load, BigWorld, Redis Clusters, Deep Neural Networks, Convolutional Neural Networks, CRM APIs, Billing, Billing Systems, SMS, Marketing Automation, Email Marketing, Affiliate Marketing, Mobile Advertising, Customer Relationship Management (CRM), Trading, Computer Vision, Computer Science, Recurrent Neural Networks (RNN), Neural Networks, Data Analysis, Data Visualization, Machine Learning, Algorithmic Trading, Mathematics, CI/CD Pipelines, Serverless, Voice, Transactional Emails, Stripe Payments, Chatbots, OCR, Telegram Bots, Healthcare IT, OAuth, Fintech
Platforms
Amazon Web Services (AWS), Docker, Ubuntu, Apache Kafka, MacOS, AWS Lambda, Telegram Bot Platform
Industry Expertise
Project Management
Education
2005 - 2009
Bachelor's Degree in Software Engineering
Almaty University of Power Engineering and Telecommunications - Almaty, Kazakhstan