Data Engineer
2013 - PRESENTAssurant- Created data pipelines using Azure Data Factory (ADF), Databricks, Python, and PySpark. Converted on-premises ETL processes into ADF pipelines for scalability.
- Designed a relational and denormalized star schema-based database and built multiple SQL databases. I also did extensive T-SQL coding in the form of stored procedures, functions, views, and ad hoc SQL scripts.
- Handled the ongoing performance tuning and SQL database and t-SQL code for optimal performance. Identified and resolved performance-related issues in production.
- Created many SQL Server Integration Services (SSIS) packages to load and process inbound files from external vendors and other internal systems. I also created SSIS packages to transform data and generate outbound file feeds.
- Interacted with end customers and business analysts to get a thorough understanding of the business requirements and deliver the right solutions.
- Created a few Power-BI and SQL Server Reporting Services (SSRS) reports for business users.
- Oversaw a team of engineers working on the project and program launch.
Technologies: SQL, Python, PySpark, SQL Server Integration Services (SSIS), Databricks, Azure Cosmos DB, Microsoft SQL Server, T-SQL, Azure Data Factory, ETL, Blob Storage, Software Development, Database Management, SQL Performance, Data Engineering, Apache Spark, Spark, Data Pipelines, Azure Synapse, Business Intelligence (BI), Data Visualization, Insurance, Insurance Industry, Microsoft Power BI, Telecommunications, Agile, Scrum, Excel 365, Data Analyst, Microsoft Excel, Data Modeling, Data Analysis, GitHub, ETL DevelopmentDBA | Data Architect
2012 - 2013Innovative Control Systems- Designed relational and star schema-based databases for the online transaction processing (OLTP) and reporting systems, respectively.
- Created the first SQL Data Warehouse for the company from the relational SQL Server database, providing the company's decision-makers with easy, almost real-time access to the sales data at the regional and store levels.
- Set up SQL Server replication from the stores to the central database. Created SSIS packages to load data from the OLTP database to the SQL Data Warehouse.
- Built cubes using SQL Server Analysis Services (SSAS), enabling the generation of sales and activity reports by time and location.
- Maintained databases, handling various actions, such as backup and restore, indexing, performance tuning, and monitoring.
Technologies: Microsoft SQL Server, T-SQL, SQL Server Integration Services (SSIS), SSAS, SSRS, Software Development, SQL Performance, Data Engineering, Data Pipelines, Data Visualization, SQL Server Analysis Services (SSAS), Database Design, Databases, Relational Databases, Excel 365, Data Analyst, Microsoft Excel, SQL, Data Modeling, Data Analysis, Data Warehousing, ETL DevelopmentConsultant | Data Architect
2010 - 2012RSG Media- Created SSIS packages to process raw-impression data, transform it into relational structured data, and load it into the SQL Server database that data scientists and analysts then use to generate pricing and demand future predictions.
- Collaborated with data scientists to understand their data needs and design the database accordingly.
- Oversaw and mentored two database developers in the team.
Technologies: SQL, SQL Server Integration Services (SSIS), Microsoft SQL Server, Media Industry, Software Development, SQL Performance, T-SQL, Data Engineering, Data Pipelines, Data Visualization, Database Design, Databases, Relational Databases, Excel 365, Data Analyst, Microsoft Excel, Data Modeling, Data Analysis, ETL DevelopmentLead DBA
2005 - 2010KGB.com- Designed, built, and maintained multiple databases for the company's application used by call center agents, their QA monitoring system, and their reporting database.
- Created a data warehouse on top of the OLTP databases that contained the call center activities of the directory assistance business, generating almost real-time reports on the call volumes.
- Implemented database partitioning to speed up search performance on a database table with over a billion records. It aimed to keep all searches under a second, helping the company process more calls with fewer call center agents.
- Set up the offshore to onshore real-time replication between SQL Server databases.
- Continued performance tuning, indexing, database backup and restore, and log shipping.
Technologies: Microsoft SQL Server, SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS), Excel VBA, Software Development, SQL Performance, T-SQL, Data Engineering, Data Pipelines, Data Visualization, SSAS, Telecommunications, Database Design, Databases, Relational Databases, Excel 365, Data Analyst, Microsoft Excel, SQL, Data Modeling, Data Analysis, Data Warehousing, ETL Development