Sergey is available for hire
Hire SergeySergey Larionov
Verified Expert in Engineering
Software Developer
Location
Wrocław, Poland
Toptal Member Since
June 18, 2020
Sergey is an Informatica PowerCenter certified specialist with about fifteen years of experience building scalable projects and systems using Oracle, SQL Server, DB2, or the Informatica platform. He enjoys working on challenging data projects and making it easy to handle large data systems. Now he masters himself as a Data Engineer with an Azure infrastructure as the primary tool.
Portfolio
AB Volvo
Linux, SQL, Oracle, IBM Db2, Netezza, Informatica PowerCenter, Azure...
Credit Suisse (Poland)
Oracle, Informatica PowerCenter, SPSS, Windows, Windows PowerShell...
Orient Express Bank (Russia)
Sybase PowerDesigner, Linux, Oracle, SQL, Informatica PowerCenter
Experience
Availability
Part-time
Preferred Environment
Microsoft SQL Server, Oracle, Unix, Linux, Windows, Informatica PowerCenter, Python, Azure, Azure Data Factory, Pipelines
The most amazing...
...thing I've coded is a script for an automatic PowerCenter objects generator when a corresponding database structure is changed.
Work Experience
Experienced Data Engineer
2017 - PRESENT
AB Volvo
- Worked on development and support of various Informatica PowerCenter workflows, including complex data loads, control flows, and more.
- Used Azure Data Factory pipelines to orchestrate the Databricks notebook loads.
- Prepared data for data scientists for predictive maintenance.
- Parsed and loaded data from XML files to Delta Lake by using Databricks and Python.
- Used Python to call an AzCopy app to operate the blobs in Azure Data Lakes.
- Controlled resource usage and React when those exceed given limits by using Azure monitoring.
Technologies: Linux, SQL, Oracle, IBM Db2, Netezza, Informatica PowerCenter, Azure, Databricks, Python, Bash Script
ETL Developer
2015 - 2017
Credit Suisse (Poland)
- Supported an inherited Oracle SQL code (procedures, triggers, etc.) without documentation.
- Worked on serial development of a PowerCenter objects list using MapGen tool.
- Developed a semi-automated SQL test engine using MS Excel.
- Built a semi-automated OBI reports test engine using Python.
- Provided deep SQL code analysis and automation to find dependencies.
- Created SQL ETL procedures to merge source and new data.
- Built a Python-based XML objects comparison tool, allowing to skip uninteresting tags.
Technologies: Oracle, Informatica PowerCenter, SPSS, Windows, Windows PowerShell, Microsoft SQL Server
ETL Developer
2013 - 2016
Orient Express Bank (Russia)
- Worked on serial development of Informatica PowerCenter objects.
- Developed a Run queue management system to run IPC workflows based on timetable or event. There is an ability to limit the number of processes running in parallel to control the load and performance, notification system, and more.
- Created a platform that can automatically generate all the code to create and update IPC objects based on the source fields list.
- Designed an automatic testing system for newly added PowerCenter mappings.
- Developed and supported VBA extensions of PowerDesigner, allowing to automatically generate set of child objects on the base of the parent one.
Technologies: Sybase PowerDesigner, Linux, Oracle, SQL, Informatica PowerCenter
ETL Expert Developer
2011 - 2013
Bank of Moscow (Russia)
- Developed a distributed Change Data Capture (CDC) system based on a trigger set.
- Built a Web Services-based system to initiate data load processes from remote branches.
- Created multi-instance parallel data load processes from remote branches to a single target object.
Technologies: Oracle SQL Data Modeler, Linux, Oracle, SQL, Informatica PowerCenter
ETL Developer
2008 - 2011
Data Integration Software (Russia)
- Contributed as a consultant to a huge variety of different customers, like banks, telecom operators, insurance companies, etc.
- Supported and developed Informatica PowerCenter objects based on technical design.
- Created testing documentation, test scenarios, cases, and customer reports.
- Distributed tasks among team members, tasks execution control, reporting to customers. The team contained a maximum of ten members: one architect, three analysts, and six developers.
Technologies: Netezza, Teradata, IBM Db2, Microsoft SQL Server, Linux, Oracle, SQL, Informatica PowerCenter
Software Engineer
2004 - 2008
Konica Minolta Photo Imaging (Russia)
- Created a technical support database, allowing to gather all services provided over technical equipment.
- Developed a marketing reporting system to show photo film sales over regions and brands.
- Test-distributed automatic photoshop system "DigiNiP."
- Built an exhibition database, allowing to sign to lectures, and printing badges.
- Developed a training department database allowing to plane lectures, distribute them among trainers, and print certificates.
Technologies: Delphi, Sybase PowerDesigner, Microsoft Access, Microsoft SQL Server
Experience
Training Team Calendar
A small project where I had to create an accounting system for a training department that wanted to have a calendar to order rooms and plan training separately for each trainer.
The technology stack included Microsoft SQL Server and Microsoft Access.
The technology stack included Microsoft SQL Server and Microsoft Access.
Integration of Mobile Billing System with Bonus Card System
I exported data from the billing system to the flat file(s), then sent them to remote FTP. After the response from the bonus card system, I had to download changed files and merge the data into the billing again.
Conditions: each file had to contain no more than the maximum amount of records, and records groups had to be placed in a single file—group breaks were prohibited.
The technology stack included Informatica PowerCenter, Oracle, and Bash.
Conditions: each file had to contain no more than the maximum amount of records, and records groups had to be placed in a single file—group breaks were prohibited.
The technology stack included Informatica PowerCenter, Oracle, and Bash.
ODS for a Bank
I was tasked with the creation of a Change Data Capture (CDC) system for a set of remote branches based on Oracle triggers. Then this data had to be periodically gathered, and an ODS had to be created using this data.
The technology stack included Oracle, Informatica PowerCenter, and IPC Web Service Hub.
The technology stack included Oracle, Informatica PowerCenter, and IPC Web Service Hub.
Script to Operate With Files
A Bash script was created to copy/move files selected by complex conditions between FTP/SFTP/SAMBA/Local sources/targets. A control file controls each instance, containing source/target type, paths, filters, and additional settings (if files are to be processed somehow during the transfer or if they are to be compressed/uncompressed, etc.).
IPC Objects Generator
An IPC contains the ability to generate mappings using template and source metadata (tables description). A set of templates was created as well as a semi-automatic system that generated source data based on changed definitions taken from the PowerDesigner model.
IPC Workflows Run Tool
I was tasked with creating a framework to start IPC workflows by event or by timetable, control the amount of processes running in parallel, notifications in case of failure, provide process dependencies, etc.
The technology stack: Oracle, and IPC.
The technology stack: Oracle, and IPC.
OBIEE Regression Testing Tool Based on Excel/VBA
The task was to compare data from two different OBIEE servers. An Excel file was created holding all possible combinations of report source fields. This Excel connected to two OBIEE servers, asked to generate reports with sets of filters applied, and compared the results.
Skills
Languages
Bash Script, SQL, XML, Python, Visual Basic for Applications (VBA), Delphi, Bash
Frameworks
Swagger, Windows PowerShell
Tools
Informatica PowerCenter, Sybase PowerDesigner, Oracle SQL Data Modeler, Microsoft Excel, SPSS, Microsoft Access, Oracle Application Express (APEX)
Paradigms
ETL
Platforms
Windows, Oracle, Unix, Linux, QlikView, Azure, Databricks
Libraries/APIs
Beautiful Soup
Storage
IBM Db2, Teradata, SQL Server 2008, Netezza, Microsoft SQL Server, Redshift
Other
Excel Macros, Scripting, Azure Data Factory, Data Build Tool (dbt), Informatics, IPC, Pipelines
Education
1999 - 2004
PhD in Electric Power | Informatics
Moscow Aviation Institute - Moscow, Russia
1993 - 1999
Bachelor of Engineering Degree in Radioelectronics
Moscow Aviation Institute - Moscow, Russia
Certifications
SEPTEMBER 2017 - PRESENT
PowerCenter Data Integration 10 Developer, Specialist Certification
Informatica University
AUGUST 2017 - PRESENT
PowerCenter Data Integration 9.x Administrator, Specialist Certification
Informatica University
SEPTEMBER 2010 - PRESENT
DEV523. Advanced Modeling Techniques using PowerDesigner 15
SAP Russia
JUNE 2009 - PRESENT
ERL15 AllFusion ERwin Data Modeler;
Moscow Training Center