Vivek Madenur
Verified Expert in Engineering
Software Developer
Vivek is a senior DevOps architect with over 15 years of experience designing and building large enterprise applications for clients, including Sky UK, Royal Dutch Shell, UK Royal Mail, RSA Insurance, UK RPA, Motorola Solutions, and Grab Singapore. He specializes in DevOps, cloud technologies, Kubernetes, Docker, data science, Python, and Django.
Portfolio
Experience
Availability
Preferred Environment
PyCharm, Slack, Visual Studio Code (VS Code), Linux, Windows, Jira, Azure DevOps, Confluence, Amazon EKS, Amazon Web Services (AWS)
The most amazing...
...highly scalable and secure solution I've architected is Alert Stack. It's based on the microservices architecture and can process 1,000 requests per second.
Work Experience
AWS DevOps Expert
Bellhop, Inc.
- Set up and migrated nearly 100 data flows from Prefect 1 to Prefect 2, improving data pipeline infrastructure on ECS.
- Achieved cost savings of approximately $2,800 per month through efficient AWS cleanup and optimization measures.
- Implemented AWS SSO for Rippling SAML authentication, enhancing security and simplifying user access management.
- Demonstrated expertise in architecting and provisioning infrastructure systems using Terraform, Terragrunt, and CircleCI, ensuring reliable and scalable deployments.
- Established observability using AWS OpenSearch, similar to ELK stack, enabling efficient monitoring and troubleshooting of system logs and metrics.
- Optimized API performance by leveraging the FastAPI framework in Python, fine-tuning Uvicorn and Gunicorn configurations, resulting in a significant fivefold increase in performance.
- Set up observability of microservices by implementing AWS App Mesh (service mesh) and AWS X-Ray, enabling comprehensive monitoring, tracing, and visualization of service communication and performance.
- Migrated PostgreSQL from Heroku to AWS RDS. Followed all the best practices for high availability, observability, and security.
DevOps Engineer
Aqueous Asset Inc.
- Created and managed pipelines for the deployment of applications using GitLab and AWS pipelines.
- Migrated legacy applications to microservices hosted on Kubernetes.
- Automated the provisioning of infrastructure using Terraform.
- Developed new features and resolved issues in a Node.js application utilizing the Express framework, contributing to the functionality and stability of the application.
- Strengthened observability by implementing effective logging and monitoring solutions using AWS services.
DevOps Consultant
Sky UK
- Architected and built a highly scalable and secure microservices solution hosted on a Kubernetes cluster. The application was capable of processing 1,000 requests per second.
- Led the design and development of data workflows using Apache Airflow (Google Composer) to pull data from various sources, such as REST API and Cloud Storage buckets, and load it into a data lake (BigQuery).
- Automated the provisioning and configuration of all the cloud resources using Terraform. Everything was provisioned on the cloud with a push of a button.
- Deployed Terraform, Airflow, BigQuery, and Python code as part of CircleCI.
- Led the development of a web application using Python and the Django framework.
- Utilized Apigee Edge for creating and managing secure, scalable APIs. Used analytics to monitor traffic and optimize performance.
Senior Technology Delivery Manager
iSteer
- Architected enterprise applications using cloud offerings in AWS and Azure. The services were hosted on Kubernetes clusters.
- Enabled the workloads to use CDN so that the latency was reduced across geographical locations.
- Coached large client teams to move from the old way of working to the Agile methodology.
- Managed projects for large-scale enterprise-grade applications.
- Implemented monitoring and alerting using ELK stack.
- Apigee: used Apigee Edge for creating secure APIs, monitoring traffic with analytics, and developing custom policies to meet business requirements. Created custom policies using Python scripts.
Technical Lead
Accenture
- Architected a large-scale enterprise solution that had many applications using EKS (Elastic Kubernetes Service) and other AWS services.
- Designed a strategy to migrate from a local data center to AWS.
- Created and implemented data migration of various data types (SQL and NoSQL) belonging to many applications.
- Implemented infrastructure monitoring using Prometheus and Grafana.
- Used PowerShell to automate many repetitive tasks and provisioned and deleted infrastructure resources. Also, to avoid configuration drift, used Desired State Configuration of PowerShell for configuration management.
Technical Lead
Accenture
- Designed and developed complex enterprise applications using various technologies such as Docker, Kubernetes, Python, Java, JMS, RDBMS, and NoSQL.
- Collaborated with various stakeholders across geographies around the globe to author functional requirements.
- Worked in various locations such as Bangalore, London, and Newcastle and with different teams, quickly adjusting to the frequently changing situations.
- Built large enterprise applications using Java-based technologies.
Experience
iDebt
Anti-piracy System
TechRefresh
Skills
Languages
Python 3, Java, SQL, Python, YAML, Bash Script, Java SE, JavaScript, Snowflake, Go
Frameworks
Django, Windows PowerShell
Tools
Terraform, Git, Amazon EKS, Azure Kubernetes Service (AKS), GitLab, Amazon Virtual Private Cloud (VPC), AWS IAM, Amazon Elastic Container Service (Amazon ECS), Amazon Elastic Container Registry (Amazon ECR), Google Compute Engine (GCE), GitHub, Ansible, Apache Airflow, Istio, NGINX, Amazon CloudWatch, Grafana, CircleCI, Helm, AWS AppSync, VPN, AWS Simple Notification Service (SNS), Cloud Dataflow, Amazon CloudFront CDN, RabbitMQ, Tableau, Docker Swarm, BigQuery, Jira, PyCharm, Slack, Confluence, Google Cloud Composer, Google Kubernetes Engine (GKE), Concourse CI, AWS CloudFormation, AWS Glue, Amazon Athena, SonarQube, Subversion (SVN), Elastic, Kibana, ELK (Elastic Stack), Jenkins, GitLab CI/CD, AWS CodeBuild, AWS CodeDeploy
Paradigms
Agile, REST, DevOps, Azure DevOps, OLAP, Serverless Architecture, Enterprise Application Architecture, Continuous Delivery (CD), Continuous Integration (CI), Agile Project Management, Testing, Microservices, Penetration Testing
Platforms
Google Cloud Platform (GCP), Azure, Docker, Kubernetes, Windows, AWS Lambda, Google App Engine, Amazon Web Services (AWS), Amazon EC2, Linux, Apache Kafka, Unix, Windows Server, Visual Studio Code (VS Code), Jakarta EE
Storage
RDBMS, OLTP, Amazon S3 (AWS S3), Google Cloud, Oracle PL/SQL, NoSQL, Amazon DynamoDB, MongoDB, PostgreSQL, Amazon EFS, Azure Active Directory, MySQL, Redis, PL/SQL, Database Migration, SQL Server 2016, Data Integration, Database Security, Elasticsearch, Google Cloud Storage, Data Pipelines
Industry Expertise
Security
Other
Google BigQuery, CI/CD Pipelines, Prometheus, Data Warehousing, Data Analysis, Cloud, Site Reliability Engineering (SRE), AWS Cloud Architecture, Containers, Container Orchestration, Containerization, Pipelines, Cloud Services, Cloud Architecture, Infrastructure as Code (IaC), Azure Virtual Machines, Application Security, Networking, Data Structures, Solution Architecture, Scripting, Serverless, Load Balancers, Enterprise Architecture, Cloud Migration, AWS DevOps, Access Control, Cloud Infrastructure, DevOps Engineer, Service Meshes, API Gateways, Azure Data Factory, Amazon Kinesis, Argo CD, DNS, SSL Certificates, Digital Certificates, Computer Science, Pub/Sub, Google Cloud Functions, Program Management, Software Architecture, Cost Estimation, Functional Requirements, Technical Design, Kubernetes Operations (kOps), Architecture, ARM, Amazon RDS, Lambda Functions, Azure SQL Data Warehouse (SQL DW), Data Quality, Shell Scripting, AWS CodePipeline, Azure PowerShell, AWS Transit Gateway, Webhooks, Cloud Run, Virtualization, Gruntwork, Prefect, Amazon OpenSearch, AWS App Mesh, AWS X-Ray
Libraries/APIs
Apigee, Node.js, React, Terragrunt
Education
Bachelor's Degree in Computer Science
Visvesvaraya Technological University - Bangalore, India
Certifications
RabbitMQ: Asynchronous Messaging with Java and Spring
Udemy
AZ-400 Designing and Implementing DevOps
Udemy
Microsoft Azure Administrator Associate
Microsoft
Microsoft Azure Administrator
Udemy
Docker Mastery: with Kubernetes + Swarm
Udemy