Arun Kumar Basnet
Verified Expert in Engineering
Data Specialist and Developer
Kathmandu, Bagmati Province, Nepal
Toptal member since August 1, 2022
Arun is a data engineer with four years of business intelligence and data warehousing expertise. His proficiency spans managing databases, crafting intricate SQL queries, leveraging cloud platforms, designing and executing ETL pipelines, and delivering impactful BI reports. Arun's extensive experience in reporting and data warehousing has enriched his skill set and honed his ability to excel within collaborative teams while maintaining exceptional client relationships.
Portfolio
Experience
- ETL - 5 years
- Data Analysis - 4 years
- SQL - 4 years
- Databases - 4 years
- Snowflake - 4 years
- Microsoft Power BI - 1 year
- Tableau - 1 year
- Azure Data Factory (ADF) - 1 year
Availability
Preferred Environment
Oracle Retail, Snowflake, Azure Data Factory (ADF), Databases, Oracle Business Intelligence Enterprise Edition 11g (OBIEE), Tableau, SQL, Data Warehousing, ADF, Python
The most amazing...
...thing I've done is designing the data mart for a client and the ETL framework and setting up the production environment with user-level security.
Work Experience
Lead Data Engineer
Elite Cloud Ops Pvt Ltd.
- Developed a Python script to scrape the web platform for multiple websites, download the data, and upload it into Azure Blob Storage.
- Created an ETL pipeline in Azure Data Factory to load the data from the Azure Blob Storage to PostgreSQL database.
- Designed and developed an ETL pipeline to orchestrate the web-scrapping scripting and data loading in the Azure PostgreSQL database.
- Designed and Implemented the database architecture for multiple datasets in Azure PostgreSQL database.
Senior Software Engineer
LIS Nepal Pvt
- Led an offshore support team for a retail client handling the deliverables. Used the Oracle BI suite, including OBIEE, BIP, ODI, and MFP.
- Acted as a technical lead for a project delivering a new data model, data warehouse architecture, and the data load logic and automating it using Azure Data Factory and tasks in Snowflake.
- Served as the subject matter expert (SME) on a project. Provided assistance to the team member on the project's issues and helped with the deliverables.
- Developed a data warehouse for a client as per their requirement. Developed ETL scripts to load targets using a Snowflake procedure. Set up and maintained the production environment of a Snowflake data warehouse and implemented role-based access.
- Analyzed Tableau reports and recreated Power BI reports related to existing ones in Tableau as part of the migration.
Data Engineer
Volvo Car
- Maintained and upgraded the data and ETL pipeline, making it ready to use for business users.
- Handled Microsoft Power BI dashboard reports development and maintenance.
- Performed historical data fixes, data validation, and pipeline fixes.
Data Engineer
Logitix - Main
- Developed an application to handle daily data exports to clients based on in-house configuration tables. Integrated the Dagster framework to handle jobs and export data to various target destinations from the config tables to multiple clients.
- Created an ETL job to extract the data from Spotify Web API and store the data in the Snowflake database. Developed a Dagster workflow to schedule and orchestrate the ETL pipeline to sync the data as per requirement.
- Handled the orchestration and modification of the existing Azure Data Factory pipelines to optimize the pipeline executions.
Software Engineer
LIS Nepal Pvt
- Developed, tested, and monitored new integration to load customer data into RA from source CRM using KSH scripts. Designed, developed, tested, and deployed the entire ETL module.
- Contributed to the history conversion of historical data from the legacy system, developed the ETL scripts for the daily batch, validated the data, and implemented Python script on the Snowflake database.
- Performed the system implementation of BI on reporting side using the MicroStrategy (MSTR) reporting tool. Built schema objects, public objects, reports, and dashboards in MSTR.
Associate Software Engineer
LIS Nepal Pvt
- Used the Oracle BI retail suite, RA and RI, acquiring functional and technical knowledge in the ODI, OBIEE, BIP, and shell scripts.
- Contributed to the Oracle Retail XStore POS solution. Used Java as a programming language, modified existing features per requirements and added new features.
- Acted as a support developer working on the OBIEE reporting, report development, and metadata modification of RPD files in OBIEE. Provided support for the reports' schedules and agents.
Experience
CRM to Data Warehouse Integration
I solely worked on the design of the ETL module, developed the load logic based on mapping documents, handled the SCD changes of the customer dimension, and validated the data. I also provided batch support for the new module.
Timesheet Data Mart
I used Azure Data Factory to orchestrate the extraction process and Snowflake procedures and tasks to handle the loading part and schedule it on a daily basis. Per the reporting needs and requirements, I developed various reporting views and enhanced the project by orchestrating the entire data flow from the Azure Data Factory. I also developed a module to notify through email in case of batch failure.
I also developed new Power BI reports and dashboards on top of the data warehouse concerning existing Tableau reports which were built on top of Excel files as part of the report migration.
Project Migration from On-premise to Cloud
MicroStrategy (MSTR) Reporting
I worked as a report developer for a client, developing the MSTR schema objects, public objects, report datasets, and dashboards. I also created the deployment packages to deploy the report objects across different environments.
Scheduler Tool for Data Export
Spotify Data Extractor
I also created a Dagster workflow to schedule and orchestrate the ETL pipeline to sync the data as per requirement.
Education
Bachelor's Degree in Computer Engineering
Kathmandu University - Dhulikhel, Kavre, Nepal
Certifications
SnowPro Advanced: Architect Certification
Snowflake
SnowPro Core Certification
Snowflake
Microsoft Certified: Azure Data Fundamentals
Microsoft
Microsoft Certified: Azure Fundamentals
Microsoft
Skills
Libraries/APIs
Pandas, REST APIs, SQLAlchemy, Spotify API
Tools
Microsoft Power BI, Jira, Oracle Business Intelligence Enterprise Edition 11g (OBIEE), Tableau, GitHub, Google Sheets, Looker, Apache Airflow, Google Forms, Kibana, BigQuery
Languages
Snowflake, SQL, Python, SQL DML, Java, Stored Procedure, T-SQL (Transact-SQL), Python 3, C++, C, R
Paradigms
ETL, OLAP, Business Intelligence (BI), Dimensional Modeling, Database Development, Requirements Analysis, Database Design, Oracle ODI, Qualitative Research
Storage
Databases, Data Integration, Data Validation, PostgreSQL, Oracle Cloud, SQL Performance, SQL Stored Procedures, Database Migration, Database Lifecycle Management (DLM), Amazon S3 (AWS S3), MySQL, Azure Blobs, Data Pipelines, Azure SQL, SQL Server Integration Services (SSIS)
Platforms
Oracle Retail, Oracle, Azure, Linux, Oracle Database, Oracle Data Integrator (ODI), Azure PaaS, Amazon Web Services (AWS), Docker
Frameworks
ADF, Apache Spark
Other
Oracle BIP, Data Warehouse Design, Data Engineering, Data Queries, Data Migration, BI Reporting, Data Architecture, Dashboards, ETL Pipelines, Data Science, Entity Relationships, Data Extraction, ETL Tools, Data Warehousing, Data Analysis, Data Visualization, Integration, Reporting, Data Analytics, Migration, Performance Tuning, Sales Reports, ELT, Scripting Languages, Data Build Tool (dbt), Data Modeling, Data Aggregation, Modeling, APIs, DAX, Data Transformation, Azure Data Factory (ADF), MicroStrategy, Shell Scripting, ETL Testing, BI Reports, Programming, Computer Graphics, Networking, Data Structures, Algorithms, Machine Learning, Artificial Intelligence (AI), Azure Data Lake, Sales, Cloud, Blob Storage, Data, Dagster, Big Data, Data Management, Data Security, Data Sharing
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring