Sergey Larionov, Bash Scripting Developer in Wrocław, Poland
Sergey Larionov

Bash Scripting Developer in Wrocław, Poland

Member since February 23, 2018
Sergey is an Informatica PowerCenter certified specialist with about ten years of experience building scalable projects and systems using Oracle, SQL Server, DB2, or Informatica platform. He enjoys working on challenging data projects and making it easy to handle large data systems. Now he slightly turns to be a Data Engineer with an Azure infrastructure as the primary tool.
Sergey is now available for hire

Portfolio

Experience

Location

Wrocław, Poland

Availability

Part-time

Preferred Environment

Microsoft SQL Server, Oracle, Unix, Linux, Windows, Informatica PowerCenter, Python, Databricks, Azure, Azure Data Factory

The most amazing...

...thing I've coded is a script for an automatic PowerCenter objects generation when a corresponding database structure is changed.

Employment

  • Senior Data Engineer

    2017 - PRESENT
    AB Volvo
    • Worked on development and support of various Informatica PowerCenter workflows - complex data loads, control flows, and more.
    • Used Azure ADF pipelines to orchestrate the Databricks notebook loads.
    • Prepared data for data scientists for predictive maintenance.
    • Parsed and loaded data from XML files to Delta Lake by using Databricks and Python.
    • Used Python to call an AzCopy app to operate the blobs in Azure Data Lakes.
    • Controlled resource usage and react when those exceed given limits by using Azure Monitoring.
    Technologies: Linux, SQL, Oracle, IBM Db2, Netezza, Informatica PowerCenter, Azure, Databricks, Python, Bash Scripting
  • ETL Developer

    2015 - 2017
    Credit Suisse (Poland)
    • Supported an inherited Oracle SQL code (procedures, triggers, etc.) without any documentation.
    • Serial development of a PowerCenter objects list using MapGen tool.
    • Developed a semi-automated SQL test engine using MS Excel.
    • Built a semi-automated OBI reports test engine using Python.
    • Provided deep SQL code analysis and automation in order to find dependencies.
    • Created SQL ETL procedures to merge source and new data.
    • Built a Python-based XML objects comparison tool, allowing to skip not-interesting tags.
    Technologies: Oracle, Informatica PowerCenter, SPSS, Windows, Windows PowerShell, Microsoft SQL Server
  • ETL Developer

    2013 - 2016
    Orient Express Bank (Russia)
    • Worked on serial development of Informatica PowerCenter objects.
    • Developed a Run queue management system, which is able to run IPC workflows based on timetable or event. There is an ability to limit the number of processes running in parallel to control the load and performance, notification system, and more.
    • Created a platform that is able to automatically generate all the code to create and update IPC objects on the basis of the source fields list.
    • Designed an automatic testing system for newly added PowerCenter mappings.
    • Developed and supported VBA extensions of PowerDesigner, allowing to automatically generate set of child objects on the base of the parent one.
    Technologies: PowerDesigner, Linux, Oracle, SQL, Informatica PowerCenter
  • ETL Expert Developer

    2011 - 2013
    Bank of Moscow (Russia)
    • Developed a distributed Change Data Capture (CDC) system on the basis of a trigger set.
    • Built a Web Services-based system to initiate data load processes from remote branches.
    • Created multi-instance parallel data load processes from remote branches to a single target object.
    Technologies: Oracle SQL Data Modeler, Linux, Oracle, SQL, Informatica PowerCenter
  • ETL Developer

    2008 - 2011
    Data Integration Software (Russia)
    • Contributed as a consultant to huge variety of different customers (banks, telecom operators, insurance companies, etc.).
    • Supported and developed Informatica PowerCenter objects on the basis of technical design.
    • Created testing documentation, test scenarios, cases, and reporting to a customer.
    • Distributed tasks among team members, tasks execution control, reporting to customers. The team contained max. ten members (one architect, three analysts, and six developers).
    Technologies: Netezza, Teradata, IBM Db2, Microsoft SQL Server, Linux, Oracle, SQL, Informatica PowerCenter
  • Software Engineer

    2004 - 2008
    Konica Minolta Photo Imaging (Russia)
    • Created a technical support database, allowing to gather all services provided over technical equipment.
    • Developed a marketing reporting system to show photo film sales over regions and brands.
    • Test-distributed automatic photoshop system "DigiNiP."
    • Built an exhibition database, allowing to sign to lectures, and printing badges.
    • Developed a training department database allowing to plane lectures, distribute them among trainers, and print certificates.
    Technologies: Delphi, PowerDesigner, Microsoft Access, Microsoft SQL Server

Experience

  • Integration of Mobile Billing System with Bonus Card System

    I had to export data from the billing system to the flat file(s), then send them to remote FTP. After response from bonus card system I had to download changed files and merge the data into the billing again.

    Conditions - each file had to contain no more than max amount of records + records groups had to be placed in a single file, group breaks were prohibited.

    Tools used - Informatica PowerCenter, Oracle, bash.

  • Training Team Calendar

    A small project where I had to create an accounting system for a training department. They wanted to have a calendar with ability to order rooms, to plan trainings separately for each trainer.

    Tools: MS SQL Server, MS Access;

  • ODS for a Bank

    I had to create Change Data Capture (CDC) system for a set of remote branches on the basis of Oracle triggers. Then this data had to be periodically gathered and an ODS had to be created using this data.

    Tools: Oracle, Informatica PowerCenter, IPC Web Service Hub.

  • Script to Operate With Files

    A bash script was created which is able to copy/move files selected by complex conditions between FTP/SFTP/SAMBA/Local sources/targets. Each instance is controlled by a control file, containing source/target type, paths, filters, additional settings (if files are to be processed somehow during the transfer, if they are to be compressed/uncompressed, etc.)

    Tools: bash scripting.

  • IPC Workflows run Tool

    The task was to create a framework able to start IPC workflows by event or by timetable, control the amount of processes running in parallel, notifications in case of failure, to provide process dependencies etc.

    Tools: Oracle, IPC.

  • OBIEE Regression Testing Tool Based on Excel/VBA

    The task was to compare data from two different OBIEE servers. An Excel file was created holding all possible combinations of report source fields. This Excel was able to connect to two OBIEE servers, ask to generate reports with sets of filters applied and compare the results.

  • IPC Objects Generator.

    An IPC contains an ability to generate mappings using template and source metadata (tables description). A set of templates was created + an semi-automatic system generating source data for them on the basis of changed definitions taken from PowerDesigner model.

Skills

  • Languages

    Bash Script, SQL, XML, Python, Visual Basic for Applications (VBA), Delphi
  • Frameworks

    Swagger, Windows PowerShell
  • Tools

    Informatica PowerCenter, Sybase PowerDesigner, Oracle SQL Data Modeler, SPSS, PowerDesigner, Microsoft Access, Oracle Application Express (APEX)
  • Paradigms

    ETL
  • Platforms

    Windows, Oracle, Unix, Linux, QlikView, Azure, Databricks
  • Libraries/APIs

    Beautiful Soup
  • Storage

    IBM Db2, Teradata, SQL Server 2008, Netezza, Microsoft SQL Server
  • Other

    Bash Scripting, Scripting, Azure Data Factory

Education

  • PhD in Electric Power, Informatics
    1999 - 2004
    Moscow Aviation Institute - Moscow, Russia
  • Bachelor of Engineering degree in Radioelectronics
    1993 - 1999
    Moscow Aviation Institute - Moscow, Russia

Certifications

  • PowerCenter Data Integration 10 Developer, Specialist Certification
    SEPTEMBER 2017 - PRESENT
    Informatica University
  • PowerCenter Data Integration 9.x Administrator, Specialist Certification
    AUGUST 2017 - PRESENT
    Informatica University
  • DEV523. Advanced Modeling Techniques using PowerDesigner 15
    SEPTEMBER 2010 - PRESENT
    SAP Russia
  • ERL15 AllFusion ERwin Data Modeler;
    JUNE 2009 - PRESENT
    Moscow Training Center

To view more profiles

Join Toptal
Share it with others