Ranjit Kumar Lakshmana Gowda

I worked for an Australian company specializing in farming solutions using machine learning and artificial intelligence. As the data engineer on the project, I delivered the following results:

• Replaced the costly streaming architecture involving Kubernetes, Event Hubs, and Cosmos DB.
• Implemented Delta Live Tables with medallion architecture to stream data and capture data change with stability and reliance.
• Minimized using multiple Event Hubs with a smart and simple design.
• Stored data on Azure Blob Storage in Delta format instead of expensive Cosmos DB and saved the customer thousands of dollars every month.
• Helped with system design and architecture.
• Compressed the data using brotli, snappy, and zlib to store historical information.

I worked on a migration project for an Australian government department. Working on this project, I extracted, integrated, and loaded data from over 15 sources using Azure Synapse Analytics and Azure Data Factory and transformed data into a medallion architecture. Furthermore, I helped generate meaningful reports from the data with PySpark's powerful transformations, set up Databricks SQL endpoints, and helped with seamless integration to Tableau and Microsoft Power BI.

I worked on Microsoft Azure cloud services and Databricks services to create data pipelines and provide insights into products, sales, and store information for data collected from over 30 countries and multiple sources.

As a lead data engineer, I worked on requirements gathering, documented HLDs and LLDs, and focused on performance improvements and cost optimizations. I used the Delta Lakehouse platform to replace Azure SQL DB to save the customer over $7,000 monthly and bring the overall pipeline time to under 1.5 hours from over 30 hours.

I worked on packages and procedures for data migration from the production environment to the test environment. By automating fixes for daily bugs using DBMS jobs and procedures, I minimized manual intervention and report generation process to run from a server and spool the necessary information for other processes.

I performed post-pay pre-bill checks before each bill run and bill run with the revenue assurance team, optimizing the billing process, handling billing changes, and assisting with resolving issues. I was in charge of Crystal Reports using PL/SQL procedures and created new packages and offers for customers.

As per the requirements provided and customer needs, I led the design and development of procedures, functions, and application programming interfaces (APIs) using PL/SQL types, interacting with the Ericsson team for interface modules.