Vivek Madenur, Developer in Bengaluru, Karnataka, India
Vivek is available for hire
Hire Vivek

Vivek Madenur

Verified Expert  in Engineering

Software Developer

Location
Bengaluru, Karnataka, India
Toptal Member Since
July 13, 2022

Vivek is a senior DevOps architect with over 15 years of experience designing and building large enterprise applications for clients, including Sky UK, Royal Dutch Shell, UK Royal Mail, RSA Insurance, UK RPA, Motorola Solutions, and Grab Singapore. He specializes in DevOps, cloud technologies, Kubernetes, Docker, data science, Python, and Django.

Portfolio

Bellhop, Inc.
Amazon EKS, Amazon Elastic Container Service (Amazon ECS)...
Aqueous Asset Inc.
Amazon Web Services (AWS), Infrastructure as Code (IaC), Networking, NGINX...
Sky UK
Google Cloud Platform (GCP), Apache Airflow, Python 3, Django, MySQL, BigQuery...

Experience

Availability

Part-time

Preferred Environment

PyCharm, Slack, Visual Studio Code (VS Code), Linux, Windows, Jira, Azure DevOps, Confluence, Amazon EKS, Amazon Web Services (AWS)

The most amazing...

...highly scalable and secure solution I've architected is Alert Stack. It's based on the microservices architecture and can process 1,000 requests per second.

Work Experience

AWS DevOps Expert

2022 - PRESENT
Bellhop, Inc.
  • Set up and migrated nearly 100 data flows from Prefect 1 to Prefect 2, improving data pipeline infrastructure on ECS.
  • Achieved cost savings of approximately $2,800 per month through efficient AWS cleanup and optimization measures.
  • Implemented AWS SSO for Rippling SAML authentication, enhancing security and simplifying user access management.
  • Demonstrated expertise in architecting and provisioning infrastructure systems using Terraform, Terragrunt, and CircleCI, ensuring reliable and scalable deployments.
  • Established observability using AWS OpenSearch, similar to ELK stack, enabling efficient monitoring and troubleshooting of system logs and metrics.
  • Optimized API performance by leveraging the FastAPI framework in Python, fine-tuning Uvicorn and Gunicorn configurations, resulting in a significant fivefold increase in performance.
  • Set up observability of microservices by implementing AWS App Mesh (service mesh) and AWS X-Ray, enabling comprehensive monitoring, tracing, and visualization of service communication and performance.
  • Migrated PostgreSQL from Heroku to AWS RDS. Followed all the best practices for high availability, observability, and security.
Technologies: Amazon EKS, Amazon Elastic Container Service (Amazon ECS), Amazon Web Services (AWS), Gruntwork, Python, Terraform, Cloud Infrastructure, Go, Data Pipelines, Prefect, CircleCI, Terragrunt, Amazon OpenSearch, Service Meshes, AWS App Mesh, AWS X-Ray, Terra

DevOps Engineer

2022 - 2023
Aqueous Asset Inc.
  • Created and managed pipelines for the deployment of applications using GitLab and AWS pipelines.
  • Migrated legacy applications to microservices hosted on Kubernetes.
  • Automated the provisioning of infrastructure using Terraform.
  • Developed new features and resolved issues in a Node.js application utilizing the Express framework, contributing to the functionality and stability of the application.
  • Strengthened observability by implementing effective logging and monitoring solutions using AWS services.
Technologies: Amazon Web Services (AWS), Infrastructure as Code (IaC), Networking, NGINX, GitLab CI/CD, Kubernetes, Node.js, JavaScript, MongoDB, Terraform, Amazon Elastic Container Service (Amazon ECS), Amazon Elastic Container Registry (ECR), AWS CodeBuild, AWS CodePipeline, AWS CodeDeploy, Amazon EKS, Kubernetes Operations (kOps), Webhooks, Microservices, Load Balancers, Enterprise Architecture, Enterprise Application Architecture, AWS DevOps, Access Control, Amazon CloudFront CDN, React, GitHub, Cloud Infrastructure, Security, DevOps Engineer

DevOps Consultant

2021 - 2023
Sky UK
  • Architected and built a highly scalable and secure microservices solution hosted on a Kubernetes cluster. The application was capable of processing 1,000 requests per second.
  • Led the design and development of data workflows using Apache Airflow (Google Composer) to pull data from various sources, such as REST API and Cloud Storage buckets, and load it into a data lake (BigQuery).
  • Automated the provisioning and configuration of all the cloud resources using Terraform. Everything was provisioned on the cloud with a push of a button.
  • Deployed Terraform, Airflow, BigQuery, and Python code as part of CircleCI.
  • Led the development of a web application using Python and the Django framework.
  • Utilized Apigee Edge for creating and managing secure, scalable APIs. Used analytics to monitor traffic and optimize performance.
Technologies: Google Cloud Platform (GCP), Apache Airflow, Python 3, Django, MySQL, BigQuery, Docker, Kubernetes, Istio, Continuous Delivery (CD), Continuous Integration (CI), Redis, Pub/Sub, Google Cloud Functions, API Gateways, Terraform, Architecture, Service Meshes, Concourse CI, Google Cloud Composer, DevOps, Apigee, OLTP, OLAP, Data Integration, Data Warehousing, Data Analysis, Database Security, CircleCI, SQL, Cloud, Site Reliability Engineering (SRE), Containers, Container Orchestration, Python, Bash Script, Containerization, YAML, Pipelines, Cloud Services, Cloud Architecture, Helm, Infrastructure as Code (IaC), GitLab, Application Security, Amazon S3 (AWS S3), DNS, VPN, Unix, SSL Certificates, Digital Certificates, AWS IAM, Networking, Data Structures, Solution Architecture, Scripting, Serverless, Serverless Architecture, Microservices, Load Balancers, Enterprise Architecture, Enterprise Application Architecture, Cloud Migration, AWS DevOps, Access Control, Google Compute Engine (GCE), Cloud Dataflow, Google Cloud Storage, Cloud Run, Penetration Testing, GitHub, Cloud Infrastructure, Security, Google Cloud, DevOps Engineer

Senior Technology Delivery Manager

2019 - 2021
iSteer
  • Architected enterprise applications using cloud offerings in AWS and Azure. The services were hosted on Kubernetes clusters.
  • Enabled the workloads to use CDN so that the latency was reduced across geographical locations.
  • Coached large client teams to move from the old way of working to the Agile methodology.
  • Managed projects for large-scale enterprise-grade applications.
  • Implemented monitoring and alerting using ELK stack.
  • Apigee: used Apigee Edge for creating secure APIs, monitoring traffic with analytics, and developing custom policies to meet business requirements. Created custom policies using Python scripts.
Technologies: Azure, Docker, Kubernetes, Amazon Web Services (AWS), Agile, Jira, Azure DevOps, Agile Project Management, Program Management, Software Architecture, DevOps, Python 3, Cost Estimation, ARM, Amazon CloudWatch, AWS CloudFormation, Architecture, Azure Data Factory, Data Integration, OLTP, OLAP, Data Warehousing, Dedicated SQL Pool (formerly SQL DW), Azure SQL Data Warehouse, Elastic, Elasticsearch, Kibana, ELK (Elastic Stack), SQL, Cloud, Site Reliability Engineering (SRE), Java, Shell Scripting, Linux, AWS Cloud Architecture, Containers, Container Orchestration, Python, Bash Script, Azure Kubernetes Service (AKS), Containerization, MongoDB, PostgreSQL, YAML, Pipelines, Cloud Services, Cloud Architecture, Helm, Infrastructure as Code (IaC), Amazon Kinesis, AWS AppSync, GitLab, Apache Kafka, Amazon EFS, Azure Virtual Machines, Application Security, Argo CD, NoSQL, Amazon Virtual Private Cloud (VPC), Amazon S3 (AWS S3), DNS, VPN, Unix, Amazon Simple Notification Service (Amazon SNS), SSL Certificates, Digital Certificates, AWS IAM, Google Cloud Platform (GCP), Amazon Elastic Container Service (Amazon ECS), Networking, Data Structures, Solution Architecture, Windows PowerShell, Azure PowerShell, Scripting, Serverless, Microservices, Load Balancers, Enterprise Architecture, Enterprise Application Architecture, Cloud Migration, AWS DevOps, Access Control, Google Compute Engine (GCE), Amazon CloudFront CDN, Snowflake, GitHub, Ansible, Jenkins, Windows, Azure Active Directory, Cloud Infrastructure, Virtualization, Security, Google Cloud, DevOps Engineer, Apigee, AWS Transit Gateway

Technical Lead

2018 - 2019
Accenture
  • Architected a large-scale enterprise solution that had many applications using EKS (Elastic Kubernetes Service) and other AWS services.
  • Designed a strategy to migrate from a local data center to AWS.
  • Created and implemented data migration of various data types (SQL and NoSQL) belonging to many applications.
  • Implemented infrastructure monitoring using Prometheus and Grafana.
  • Used PowerShell to automate many repetitive tasks and provisioned and deleted infrastructure resources. Also, to avoid configuration drift, used Desired State Configuration of PowerShell for configuration management.
Technologies: Amazon Web Services (AWS), Amazon DynamoDB, AWS Lambda, API Gateways, NGINX, Kubernetes, Amazon EKS, Amazon RDS, RDBMS, Terraform, Ansible, Database Migration, AWS Glue, Amazon Athena, PL/SQL, SQL, Amazon EC2, Prometheus, Grafana, Data Analysis, Azure Data Factory, Jenkins, CircleCI, Cloud, Site Reliability Engineering (SRE), AWS Cloud Architecture, Containers, Container Orchestration, Python, Azure Kubernetes Service (AKS), JavaScript, Containerization, MongoDB, PostgreSQL, YAML, Pipelines, Cloud Services, Cloud Architecture, Infrastructure as Code (IaC), Amazon Kinesis, AWS AppSync, GitLab, Amazon EFS, Azure Virtual Machines, Application Security, NoSQL, Amazon Virtual Private Cloud (VPC), Amazon S3 (AWS S3), Unix, AWS IAM, Amazon Elastic Container Service (Amazon ECS), Networking, Data Structures, Solution Architecture, Scripting, Windows PowerShell, Enterprise Architecture, AWS DevOps, Access Control, Penetration Testing, GitHub, Windows, Windows Server, Azure Active Directory, Cloud Infrastructure, Security, DevOps Engineer, Tableau

Technical Lead

2007 - 2018
Accenture
  • Designed and developed complex enterprise applications using various technologies such as Docker, Kubernetes, Python, Java, JMS, RDBMS, and NoSQL.
  • Collaborated with various stakeholders across geographies around the globe to author functional requirements.
  • Worked in various locations such as Bangalore, London, and Newcastle and with different teams, quickly adjusting to the frequently changing situations.
  • Built large enterprise applications using Java-based technologies.
Technologies: Google Cloud Platform (GCP), Azure, Agile Project Management, Functional Requirements, Technical Design, Java, Python 3, Testing, RDBMS, PL/SQL, Amazon Web Services (AWS), Data Warehousing, Data Integration, OLTP, OLAP, Data Quality, Database Security, Data Analysis, SQL, Cloud, Java SE, Jakarta EE, Shell Scripting, Linux, AWS Cloud Architecture, Containers, Bash Script, JavaScript, YAML, Cloud Services, Application Security, Unix, Data Structures, GitHub, Oracle PL/SQL, Tableau

iDebt

iDebt is a CRM application to manage the operation of a debt collection authority in Australia. I architected and led the build effort for a highly sophisticated microservices architecture-based system on AWS. The solution was highly scalable and secure and used all the best practices. The application code and infrastructure deployment were automated as part of CI/CD.

Anti-piracy System

A data lake system to consolidate anti-piracy data from a mix of data sources. I led the design and development of data workflows using Apache Airflow and a web application using the Django and Python.

TechRefresh

Led the architecture and design effort to upgrade the entire IT solution of an insurance company. The solution was built on microservices architecture using Elastic Kubernetes Service and other AWS services.

Languages

Python 3, Java, SQL, Python, YAML, Bash Script, Java SE, JavaScript, Snowflake, Go, Terra

Frameworks

Django, Windows PowerShell

Tools

Terraform, Git, Amazon EKS, Azure Kubernetes Service (AKS), GitLab, Amazon Virtual Private Cloud (VPC), AWS IAM, Amazon Elastic Container Service (Amazon ECS), Amazon Elastic Container Registry (ECR), Google Compute Engine (GCE), GitHub, Ansible, Apache Airflow, Istio, NGINX, Amazon CloudWatch, Grafana, CircleCI, Helm, AWS AppSync, VPN, Amazon Simple Notification Service (Amazon SNS), Cloud Dataflow, Amazon CloudFront CDN, RabbitMQ, Tableau, Docker Swarm, BigQuery, Jira, PyCharm, Slack, Confluence, Google Cloud Composer, Google Kubernetes Engine (GKE), Concourse CI, AWS CloudFormation, AWS Glue, Amazon Athena, SonarQube, Subversion (SVN), Elastic, Kibana, ELK (Elastic Stack), Jenkins, GitLab CI/CD, AWS CodeBuild, AWS CodeDeploy, Amazon OpenSearch

Paradigms

Agile, REST, DevOps, Azure DevOps, OLAP, Serverless Architecture, Enterprise Application Architecture, Continuous Delivery (CD), Continuous Integration (CI), Agile Project Management, Testing, Microservices, Penetration Testing

Platforms

Google Cloud Platform (GCP), Azure, Docker, Kubernetes, Windows, AWS Lambda, Google App Engine, Amazon Web Services (AWS), Amazon EC2, Linux, Apache Kafka, Unix, Windows Server, Visual Studio Code (VS Code), Azure SQL Data Warehouse, Jakarta EE, Cloud Run, Dedicated SQL Pool (formerly SQL DW)

Storage

RDBMS, OLTP, Amazon S3 (AWS S3), Google Cloud, Oracle PL/SQL, NoSQL, Amazon DynamoDB, MongoDB, PostgreSQL, Amazon EFS, Azure Active Directory, MySQL, Redis, PL/SQL, Database Migration, SQL Server 2016, Data Integration, Database Security, Elasticsearch, Google Cloud Storage, Data Pipelines

Other

Google BigQuery, CI/CD Pipelines, Prometheus, Data Warehousing, Data Analysis, Cloud, Site Reliability Engineering (SRE), AWS Cloud Architecture, Containers, Container Orchestration, Containerization, Pipelines, Cloud Services, Cloud Architecture, Infrastructure as Code (IaC), Azure Virtual Machines, Application Security, Networking, Data Structures, Solution Architecture, Scripting, Serverless, Load Balancers, Enterprise Architecture, Cloud Migration, AWS DevOps, Access Control, Cloud Infrastructure, Security, DevOps Engineer, Service Meshes, API Gateways, Azure Data Factory, Amazon Kinesis, Argo CD, DNS, SSL Certificates, Digital Certificates, Computer Science, Pub/Sub, Google Cloud Functions, Program Management, Software Architecture, Cost Estimation, Functional Requirements, Technical Design, Kubernetes Operations (kOps), Architecture, ARM, Amazon RDS, Lambda Functions, Data Quality, Shell Scripting, AWS CodePipeline, Azure PowerShell, AWS Transit Gateway, Webhooks, Virtualization, Gruntwork, Prefect, AWS App Mesh, AWS X-Ray

Libraries/APIs

Apigee, Node.js, React, Terragrunt

2003 - 2007

Bachelor's Degree in Computer Science

Visvesvaraya Technological University - Bangalore, India

OCTOBER 2021 - PRESENT

RabbitMQ: Asynchronous Messaging with Java and Spring

Udemy

SEPTEMBER 2021 - PRESENT

AZ-400 Designing and Implementing DevOps

Udemy

SEPTEMBER 2021 - SEPTEMBER 2022

Microsoft Azure Administrator Associate

Microsoft

AUGUST 2021 - PRESENT

Microsoft Azure Administrator

Udemy

JUNE 2021 - PRESENT

Docker Mastery: with Kubernetes + Swarm

Udemy

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring