
Vladimir Senatorov
Verified Expert in Engineering
Data Engineer and Software Developer
Vladimir has been developing database solutions for 20+ years in developer, architect, and team leader roles. He has specialized in data integration and transformation for data warehouses, BI systems, and process mining systems, using SQL and ETL tools for the last decade. Over the years, Vladimir has proven his ability to use non-trivial approaches to effectively solve challenging data processing problems.
Portfolio
Experience
Availability
Preferred Environment
PostgreSQL, Celonis, SQL, Azure Data Factory, Azure SQL Databases, Microsoft SQL Server, Oracle, Python, Apache Airflow, Microsoft Power BI
The most amazing...
...system I've designed and developed was a BI-reporting tool, combining a relational OLAP approach with the full-text search capabilities of MS SQL Server.
Work Experience
Senior Data Engineer, Process Mining
RAMAX International
- Designed and developed data integrations from production systems to data warehouses for process-mining solutions for three projects. The integrations were built using Pentaho Data Integration (PDI) and Apache Airflow.
- Developed SQL transformations of digital footprints of processes into more than seven process-mining data models. Optimized performance of SQL transformations.
- Administered the Celonis server, Apache Airflow, Jenkins, and PostgreSQL.
Data Engineer
Azrieli Ecommerce Ltd.
- Developed Azure Data Factory (ADF) pipelines for integration of various data sources—Sylius (retail sales), Mirakl (wholesale purchases), AirTable (data input for BI systems), Kustomer (chats with customers), plus some legacy systems.
- Set up several processes for consuming REST API paginated outputs from various endpoints using ADF. Set up some data parsing processes for received REST API JSON data.
- Developed SQL Server back-end data structures and stored procedures to work with ADF pipelines. Created SQL Server stored procedures for regular copying data between DWH areas and updating the slowly changing dimensions (type 2).
Senior Consultant
Tern Group
- Developed, as part of a team, an MS SQL-based analytical data warehouse for pharmaceutical data, including retail sales, wholesales, medical rep promotion data, and more.
- Developed, as part of a team, a PL/SQL-based, back-end API for retrieving information by a web-based front end.
- Developed XML-data integrations and transformations using SAP BODS and Oracle.
Architect, Developer
Self-employed
- Developed a system for integrating XML files. The system provided daily conversion of thousands of files (dozens of XSD schemas) into a single analytical data mart.
- Designed a reporting engine that produced analytical output from structured-relational data and full-text indexes of unstructured files in office formats.
- Developed a "semaphore" system that coordinates various tasks such as FTP download, unzipping, upload to the database, data transformation, HTTP-files download for full-text indexing, and analytical data-marts updating in the data update pipeline.
Team Leader, Architect, Developer
Remedium Group
- Designed a set of analytical tools for clients to study pharmaceutical audit data and create their reports. The tools (several versions) were universal ROLAP-type report generators based on the MS SQL data engine.
- Developed a management-accounting system for the holding company (15+ legal entities), including data input via MS Access forms, MS SQL as data storage, and MS Excel as a reporting engine connected to the database via pivot tables.
- Designed a data-processing pipeline for drug audits (retail and hospital), including data collection, data integration, MDM and bridging source data to the master dictionary, statistical extrapolation, and the delivery of audits data to customers.
- Prepared and supervised the implementation of a long-term, post-acquisition SLA with IMS Health (iqvia.com), covering terms, conditions, and benchmarks of the outsourcing services provided to IMS by the employer (the Remedium Group).
Experience
Management Accounting System for a Holding Company
The financial analyst of the holding was performing data entry by companies with a breakdown by projects, periods, and expense items with attribution to cost and profit centers.
The user interface for the data entry was developed using MS Access forms.
The back end of the system was an MS SQL database.
Reporting was developed using MS Excel connected to the database via the pivot-tables mechanism.
XLM Data Integration Framework
1. Loading the contents of XML files of various schemas into a single database table.
2. Parsing XSD files of XML schemas into a tabular format.
3. Using table (2) information to create templates for mapping source data elements to the target database structure.
4. Applying templates (3) to loaded data (1) to automatically transform source XML files data into the target relational data structure.
The implemented system made it possible to set up the daily integration of open public procurement data (zakupki.gov.ru), consisting of thousands of XML files of dozens of schemas each day.
Process Mining Solution for ITSM
The solution included:
1. Building local process mining data warehouse (PostgreSQL), updated hourly from production assyst system (MS SQL) using incremental sync. The sync was developed using Pentaho DI.
2. Applying transformations of source data into the process mining data model. The model contained all types of high-level ITSM tasks (incidents and change requests) and "child" tasks and decision tasks for each instance. Transformations were developed using pgSQL. The model included many additional attributes and measures obtained from the source data and calculated on the fly.
3. Setting up regular (hourly) updates of the Celonis data model using Jenkins.
Skills
Languages
T-SQL (Transact-SQL), SQL, Excel VBA, Python, Visual Basic for Applications (VBA), Stored Procedure, XML, Snowflake
Libraries/APIs
REST APIs
Tools
Microsoft Access, Microsoft Excel, Microsoft Power BI, Power Pivot, Apache Airflow, Jenkins, Pentaho Data Integration (Kettle), Akeneo, Asana
Paradigms
ETL, Dimensional Modeling, Business Intelligence (BI), Database Design, Database Development, OLAP
Platforms
Oracle, Azure, Linux, Databricks
Storage
PL/SQL, PostgreSQL, SQL Server Integration Services (SSIS), Microsoft SQL Server, Data Integration, Databases, SQL Server DBA, Data Pipelines, Relational Databases, Database Management, SQL Server 2016, Azure SQL Databases, JSON, Database Administration (DBA), Oracle PL/SQL, Database Architecture, Dynamic SQL, OLTP, SQL Stored Procedures, SQL Server Analysis Services (SSAS), Azure Cloud Services, SQL Server Reporting Services (SSRS), NoSQL
Other
Celonis, Excel Expert, Data Warehousing, Pivot Tables, Data Engineering, Data Modeling, Process Mining, Data Analytics, Data Analysis, Data Architecture, Data Warehouse Design, Technical Writer, Technical Writing, APIs, Analytics, Azure Data Factory, Performance Tuning, Query Composition, Query Optimization, Back-end, Data, Data Migration, ETL Tools, Data Management, PL/SQL Tuning, ELT, Excel 365, Data Structures, Dashboards, Solution Architecture, Technical Architecture, Data Governance, SAP BusinessObjects Data Service (BODS), Mathematics, Statistics, Programming, System Design, SAP BusinessObjects (BO), Cloud, Data Visualization, Microsoft Azure Cloud Server, Data Build Tool (dbt), System Administration, SSRS Reports, Azure SQL Data Warehouse (SQL DW), DAX, eCommerce, Metabase, Mirakl, Airtable, Kustomer, Unix Shell Scripting
Frameworks
Sylius
Education
Master's Degree in Informatics and Applied Mathematics
Institute of Cryptography, Telecommunications and Computer Science - Moscow, Russia
Certifications
Celonis Implementation Professional
Celonis Academy
Celonis Data Engineer
Celonis Academy
SAP Certified Application Associate - Data Integration with SAP Data Services 4.2
SAP SE