Vladimir is available for hire
Hire VladimirVladimir Senatorov
Verified Expert in Engineering
Data Engineer and Software Developer
Location
Moscow, Russia
Toptal Member Since
October 26, 2021
Vladimir has been developing database solutions for 20+ years in developer, architect, and team leader roles. He has specialized in data integration and transformation for data warehouses, BI systems, and process mining systems, using SQL and ETL tools for the last decade. Over the years, Vladimir has proven his ability to use non-trivial approaches to effectively solve challenging data processing problems.
Portfolio
RAMAX International
Celonis, Apache Airflow, Data Integration, Data Warehousing, Jenkins...
Azrieli Ecommerce Ltd.
T-SQL (Transact-SQL), SQL, Business Intelligence (BI), Azure Cloud Services...
Tern Group
Oracle, PL/SQL, Microsoft SQL Server, T-SQL (Transact-SQL)...
Experience
Availability
Full-time
Preferred Environment
PostgreSQL, Celonis, SQL, Azure Data Factory, Azure SQL Databases, Microsoft SQL Server, Oracle, Python, Apache Airflow, Microsoft Power BI
The most amazing...
...system I've designed and developed was a BI-reporting tool, combining a relational OLAP approach with the full-text search capabilities of MS SQL Server.
Work Experience
Senior Data Engineer, Process Mining
2019 - PRESENT
RAMAX International
- Designed and developed data integrations from production systems to data warehouses for process-mining solutions for three projects. The integrations were built using Pentaho Data Integration (PDI) and Apache Airflow.
- Developed SQL transformations of digital footprints of processes into more than seven process-mining data models. Optimized performance of SQL transformations.
- Administered the Celonis server, Apache Airflow, Jenkins, and PostgreSQL.
Technologies: Celonis, Apache Airflow, Data Integration, Data Warehousing, Jenkins, PostgreSQL, Oracle, Linux, Pentaho Data Integration (Kettle), Microsoft SQL Server, Data Modeling, ETL, Data Engineering, Data Pipelines, SQL, Cloud, Process Mining, Data Analytics, Data Analysis, Python, Business Intelligence (BI), Database Management, Database Design, Analytics, JSON, REST APIs, Databases, Microsoft Excel, Performance Tuning, Query Composition, Query Optimization, Back-end, Technical Writing, Technical Writer, Data, Data Migration, Data Build Tool (dbt), System Administration, SQL Server DBA, ETL Tools, Data Management, PL/SQL Tuning, Oracle PL/SQL, Unix Shell Scripting, ELT, Excel 365, Data Structures, Database Development, Data Architecture, Dashboards, Solution Architecture, Azure SQL Data Warehouse (SQL DW), Stored Procedure, Database Architecture, NoSQL, Dynamic SQL, OLTP, OLAP, SQL Stored Procedures
Data Engineer
2022 - 2023
Azrieli Ecommerce Ltd.
- Developed Azure Data Factory (ADF) pipelines for integration of various data sources—Sylius (retail sales), Mirakl (wholesale purchases), AirTable (data input for BI systems), Kustomer (chats with customers), plus some legacy systems.
- Set up several processes for consuming REST API paginated outputs from various endpoints using ADF. Set up some data parsing processes for received REST API JSON data.
- Developed SQL Server back-end data structures and stored procedures to work with ADF pipelines. Created SQL Server stored procedures for regular copying data between DWH areas and updating the slowly changing dimensions (type 2).
Technologies: T-SQL (Transact-SQL), SQL, Business Intelligence (BI), Azure Cloud Services, Microsoft SQL Server, Azure Data Factory, Microsoft Azure Cloud Server, ETL, eCommerce, Sylius, Akeneo, Metabase, Mirakl, Airtable, Kustomer, REST APIs, Asana, Technical Writing, JSON, Azure SQL Databases, Data Integration, Data Warehousing, Databases, Data Engineering, Performance Tuning, Query Composition, Query Optimization, Snowflake, Back-end, Technical Writer, Azure, Data, Data Migration, Database Administration (DBA), ETL Tools, Data Management, ELT, Python, Excel 365, Data Structures, Database Development, Data Architecture, Dashboards, Solution Architecture, Technical Architecture, Azure SQL Data Warehouse (SQL DW), Stored Procedure, Database Architecture, NoSQL, Dynamic SQL, OLTP, OLAP, SQL Stored Procedures, APIs
Senior Consultant
2017 - 2019
Tern Group
- Developed, as part of a team, an MS SQL-based analytical data warehouse for pharmaceutical data, including retail sales, wholesales, medical rep promotion data, and more.
- Developed, as part of a team, a PL/SQL-based, back-end API for retrieving information by a web-based front end.
- Developed XML-data integrations and transformations using SAP BODS and Oracle.
Technologies: Oracle, PL/SQL, Microsoft SQL Server, T-SQL (Transact-SQL), SAP BusinessObjects Data Service (BODS), SAP BusinessObjects (BO), SQL Server Integration Services (SSIS), SQL, ETL, Data Modeling, Data Engineering, Data Pipelines, Dimensional Modeling, Relational Databases, Data Analytics, Business Intelligence (BI), Database Management, SQL Server 2016, Data Warehouse Design, APIs, Database Design, Asana, REST APIs, Data Integration, Data Warehousing, Databases, Excel VBA, Microsoft Excel, Pivot Tables, Performance Tuning, Query Composition, Query Optimization, Back-end, Technical Writing, Data Migration, Database Administration (DBA), ETL Tools, Data Management, PL/SQL Tuning, Oracle PL/SQL, Unix Shell Scripting, ELT, Excel 365, Data Structures, Database Development, Dashboards, Technical Architecture, Stored Procedure, Database Architecture, NoSQL, Dynamic SQL, Data Governance, OLTP, OLAP, SQL Stored Procedures, DAX
Architect, Developer
2014 - 2017
Self-employed
- Developed a system for integrating XML files. The system provided daily conversion of thousands of files (dozens of XSD schemas) into a single analytical data mart.
- Designed a reporting engine that produced analytical output from structured-relational data and full-text indexes of unstructured files in office formats.
- Developed a "semaphore" system that coordinates various tasks such as FTP download, unzipping, upload to the database, data transformation, HTTP-files download for full-text indexing, and analytical data-marts updating in the data update pipeline.
Technologies: Microsoft SQL Server, T-SQL (Transact-SQL), SQL Server DBA, SQL, ETL, Data Modeling, Data Pipelines, Data Engineering, Dimensional Modeling, Relational Databases, Data Analytics, Data Analysis, Business Intelligence (BI), Database Management, Data Warehouse Design, Database Design, Visual Basic for Applications (VBA), Analytics, Data Integration, Data Warehousing, Databases, Excel VBA, Microsoft Excel, Pivot Tables, Performance Tuning, Query Composition, Query Optimization, Technical Writing, Microsoft Power BI, SQL Server Integration Services (SSIS), Data, Data Migration, Database Administration (DBA), System Administration, ETL Tools, Data Management, ELT, Microsoft Access, Excel 365, Data Structures, Database Development, SSRS Reports, Dashboards, SQL Server Reporting Services (SSRS), Solution Architecture, Technical Architecture, Stored Procedure, Database Architecture, NoSQL, Dynamic SQL, Data Governance, OLTP, OLAP, SQL Stored Procedures, DAX
Team Leader, Architect, Developer
2000 - 2013
Remedium Group
- Designed a set of analytical tools for clients to study pharmaceutical audit data and create their reports. The tools (several versions) were universal ROLAP-type report generators based on the MS SQL data engine.
- Developed a management-accounting system for the holding company (15+ legal entities), including data input via MS Access forms, MS SQL as data storage, and MS Excel as a reporting engine connected to the database via pivot tables.
- Designed a data-processing pipeline for drug audits (retail and hospital), including data collection, data integration, MDM and bridging source data to the master dictionary, statistical extrapolation, and the delivery of audits data to customers.
- Prepared and supervised the implementation of a long-term, post-acquisition SLA with IMS Health (iqvia.com), covering terms, conditions, and benchmarks of the outsourcing services provided to IMS by the employer (the Remedium Group).
Technologies: Microsoft SQL Server, T-SQL (Transact-SQL), SQL Server Integration Services (SSIS), Excel Expert, Microsoft Access, Power Pivot, SQL Server Analysis Services (SSAS), Excel VBA, Data Modeling, Data Pipelines, ETL, Data Engineering, SQL, Data Analytics, Data Visualization, Data Analysis, Data Architecture, Business Intelligence (BI), Database Management, Technical Writing, Database Design, Visual Basic for Applications (VBA), Data Integration, Data Warehousing, Databases, Microsoft Excel, Pivot Tables, Performance Tuning, Query Composition, Query Optimization, Microsoft Power BI, Technical Writer, Data, Data Migration, System Administration, Data Management, ELT, Excel 365, Data Structures, Database Development, SSRS Reports, Dashboards, SQL Server Reporting Services (SSRS), Solution Architecture, Technical Architecture, Stored Procedure, Database Architecture, NoSQL, Dynamic SQL, Data Governance, OLTP, OLAP, SQL Stored Procedures
Experience
Management Accounting System for a Holding Company
The main goal of creating the system was to obtain consolidated reporting on the holding company's projects implemented through various legal entities.
The financial analyst of the holding was performing data entry by companies with a breakdown by projects, periods, and expense items with attribution to cost and profit centers.
The user interface for the data entry was developed using MS Access forms.
The back end of the system was an MS SQL database.
Reporting was developed using MS Excel connected to the database via the pivot-tables mechanism.
The financial analyst of the holding was performing data entry by companies with a breakdown by projects, periods, and expense items with attribution to cost and profit centers.
The user interface for the data entry was developed using MS Access forms.
The back end of the system was an MS SQL database.
Reporting was developed using MS Excel connected to the database via the pivot-tables mechanism.
XLM Data Integration Framework
The unified process of XML data integration consists of the following steps:
1. Loading the contents of XML files of various schemas into a single database table.
2. Parsing XSD files of XML schemas into a tabular format.
3. Using table (2) information to create templates for mapping source data elements to the target database structure.
4. Applying templates (3) to loaded data (1) to automatically transform source XML files data into the target relational data structure.
The implemented system made it possible to set up the daily integration of open public procurement data (zakupki.gov.ru), consisting of thousands of XML files of dozens of schemas each day.
1. Loading the contents of XML files of various schemas into a single database table.
2. Parsing XSD files of XML schemas into a tabular format.
3. Using table (2) information to create templates for mapping source data elements to the target database structure.
4. Applying templates (3) to loaded data (1) to automatically transform source XML files data into the target relational data structure.
The implemented system made it possible to set up the daily integration of open public procurement data (zakupki.gov.ru), consisting of thousands of XML files of dozens of schemas each day.
Process Mining Solution for ITSM
The process mining (Celonis) data model was generated from digital footprints from the Axios assyst ITSM automation system.
The solution included:
1. Building local process mining data warehouse (PostgreSQL), updated hourly from production assyst system (MS SQL) using incremental sync. The sync was developed using Pentaho DI.
2. Applying transformations of source data into the process mining data model. The model contained all types of high-level ITSM tasks (incidents and change requests) and "child" tasks and decision tasks for each instance. Transformations were developed using pgSQL. The model included many additional attributes and measures obtained from the source data and calculated on the fly.
3. Setting up regular (hourly) updates of the Celonis data model using Jenkins.
The solution included:
1. Building local process mining data warehouse (PostgreSQL), updated hourly from production assyst system (MS SQL) using incremental sync. The sync was developed using Pentaho DI.
2. Applying transformations of source data into the process mining data model. The model contained all types of high-level ITSM tasks (incidents and change requests) and "child" tasks and decision tasks for each instance. Transformations were developed using pgSQL. The model included many additional attributes and measures obtained from the source data and calculated on the fly.
3. Setting up regular (hourly) updates of the Celonis data model using Jenkins.
Skills
Languages
T-SQL (Transact-SQL), SQL, Excel VBA, Python, Visual Basic for Applications (VBA), Stored Procedure, XML, Snowflake
Libraries/APIs
REST APIs
Tools
Microsoft Access, Microsoft Excel, Microsoft Power BI, Power Pivot, Apache Airflow, Jenkins, Pentaho Data Integration (Kettle), Akeneo, Asana
Paradigms
ETL, Dimensional Modeling, Business Intelligence (BI), Database Design, Database Development, OLAP
Platforms
Oracle, Azure, Linux, Databricks
Storage
PL/SQL, PostgreSQL, SQL Server Integration Services (SSIS), Microsoft SQL Server, Data Integration, Databases, SQL Server DBA, Data Pipelines, Relational Databases, Database Management, SQL Server 2016, Azure SQL Databases, JSON, Database Administration (DBA), Oracle PL/SQL, Database Architecture, Dynamic SQL, OLTP, SQL Stored Procedures, SQL Server Analysis Services (SSAS), Azure Cloud Services, SQL Server Reporting Services (SSRS), NoSQL
Other
Celonis, Excel Expert, Data Warehousing, Pivot Tables, Data Engineering, Data Modeling, Process Mining, Data Analytics, Data Analysis, Data Architecture, Data Warehouse Design, Technical Writer, Technical Writing, APIs, Analytics, Azure Data Factory, Performance Tuning, Query Composition, Query Optimization, Back-end, Data, Data Migration, ETL Tools, Data Management, PL/SQL Tuning, ELT, Excel 365, Data Structures, Dashboards, Solution Architecture, Technical Architecture, Data Governance, SAP BusinessObjects Data Service (BODS), Mathematics, Statistics, Programming, System Design, SAP BusinessObjects (BO), Cloud, Data Visualization, Microsoft Azure Cloud Server, Data Build Tool (dbt), System Administration, SSRS Reports, Azure SQL Data Warehouse (SQL DW), DAX, eCommerce, Metabase, Mirakl, Airtable, Kustomer, Unix Shell Scripting
Frameworks
Sylius
Education
1987 - 1992
Master's Degree in Informatics and Applied Mathematics
Institute of Cryptography, Telecommunications and Computer Science - Moscow, Russia
Certifications
MAY 2021 - MAY 2022
Celonis Implementation Professional
Celonis Academy
MARCH 2020 - MARCH 2021
Celonis Data Engineer
Celonis Academy
FEBRUARY 2019 - PRESENT
SAP Certified Application Associate - Data Integration with SAP Data Services 4.2
SAP SE