Bibeksheel Kaur

A project to migrate an on-prem data warehouse reporting solution to Microsoft Azure. It contains 100+ tables and 50+ stored procedures, which have to be rescripted in Spark SQL, PySpark, and Scala. End reporting tables will be presented as a Microsoft Power BI report to the business users who will consume the data for analysis and prediction purposes.

ACCOMPLISHMENTS
• Used Azure Data Factory to build pipelines for extracting source data from SQL tables and FlatFiles.
• Rescripted the transformation logic by scripting it in Spark SQL, PySpark, and Scala.
• Recreated existing business logic and functionality using Azure stack.
• Designed, developed, and deployed the solution.
• Implemented end-to-end data solutions (storage, integration, processing, visualization) in Azure.

An enterprise-wide data warehouse platform to migrate the existing on-prem data residing locally to a global cloud platform and run analytics on top of the data, which will be used for decision-making and predictive analysis.
- Migrate the existing ETL stack from SSIS to the Azure platform.
- Redesign the existing DW solution by writing it in Databricks and integrating it.
- Architect and implement medium to large scale BI solutions on Azure using Azure Data Platform services (Azure Data Lake, Data Factory, Azure SQL DW, and HDInsight/Databricks)
- Recreating existing application logic and functionality in the Azure Data Lake, Data Factory, SQL Database and SQL data warehouse environment. experience in DWH/BI project implementation using Azure DF.
- Propose architectures considering cost/spend in Azure and develop recommendations to right-size data infrastructure
- Implement end-to-end data solutions (storage, integration, processing, visualization) in Azure
- Migrate on-premise data (Oracle/SQL Server/Mainframe) to Azure Data Lake Storage using Azure Data Factory.
- Create dashboards on the delta tables in Azure Databricks and present the analytics per requirements

I migrated 30 years of historical data from Mainframe files to Azure, where I migrated 3,000 files from the mainframe system to Azure Data Lake storage.
I populated the data in Azure tables (CosmosDB).

ACCOMPLISHMENTS
• Created Python scripts to refine the Mainframe historical files so that they are eligible for processing in Azure.
• Created Delta tables from the flat files in Azure Databricks and created a data model on top of it.
• Set up the ETL process for rendering monthly reports from Azure for future use.

• Worked as the offshore lead in this project, managing a data warehouse for a mining company.
• Deployed and uploaded the SSRS reports to SharePoint Server for the end-users and involved in enhancements and modifications.
• Managed the subscription reports for the end users.
• Created databases and schema objects, including tables, indexes, and applied constraints.
• Connected various applications to the database, written functions, and stored procedures and triggers.
• Used SSIS transformations such as lookup, derived column, data conversion, aggregate, conditional splits, SQL tasks, script tasks, send mail tasks, and more.
• Used execution plans, SQL profiler, and database engine tuning advisor to optimize queries and enhance the performance of databases.
• Supported various BAU activities such as defect prevention, change management, incident management, and problem management.
• Monitored and made recommendations for performance improvement in hosted databases involving partitioning, index creation, index removal, index modification, and adding scheduled jobs to re-index and update database statistics.
• Monitored 100+ jobs and troubleshoot and reported in case of failure.

Worked as an onsite coordinator in the UK for a year, supporting travel insurance annual review processing according to the eligibility rules provided by the business and informing users regarding entitlement, confirmation, and revocation of their travel insurance. Optimized and re-engineered the travel insurance process for current accounts nationwide. Supported flex account travel insurance processing and answered business queries related to customers' data.

Re-designed the statement mailing process for savings customers nationwide to reduce the overall cost by US $0.9 million. Identified the loopholes in the existing logic and provided solutions for them. Supported the critical process of annual savings mailings to send the yearly statements to 11 million savings account stakeholders.

Served as an offshore coordinator and acted as a bridge between the client and developers. Also worked as a SQL developer and developed stored procedures, functions, table scripts, and rewrites of stored procedures to improve performance. Worked on unit testing by applying various positive and negative test cases to provide defect-free solutions. Created SSIS packages for the smooth flow of data between different sources.

Supported critical business activities and created SQL script queries to resolve business queries. Supported various BAU activities such as defect prevention, change, incident, and problem management. Supported incident monitoring activities and resolved incidents quickly. Handled business queries and CSR (service requests), involved in developing and enhancing 20+ marts (SQL stored procedures). Monitored and made recommendations for performance improvement in hosted databases involving partitioning, index creation, index removal, index modification, and adding scheduled jobs to re-index and update statistics in databases. Involved in troubleshooting and fine-tuning of databases for its performance and concurrency.

AQC is a Java/Jakarta EE web-based application that provides rating and quotation services for Aetna's medical, life, and dental insurance product application development in Java using Spring MVC and Struts framework with Waterfall and Agile SDLC models. I worked on various database issues plaguing a complex software system related to concurrency, caching, tuning of databases, and query optimization and analyzed and resolved existing bugs in the application.

• Maintained and supported 80+ applications and tools developed in .NET.
• Made necessary updates and generated reports using SQL queries and worked in Active Directory.
• Created T-SQL stored procedures and traced and analyzed the stored procedures for performance and cost optimization.
• Developed tools in .NET to automate various infrastructure management service activities to deliver exceptional client service.