Waldemar Scigajlo

This test automation tool was written using Groovy. It uses XML as the input files, along with the definition of tests and predefined assertions, such as comparing counts of rows, whole query sets, or database structures. It executes the assertions simultaneously, reusing connections and returned data sets for better performance, not holding entire data sets in its memory. The tool is platform-independent and extendable. Users may write their own assertion, compile them, or simply add it to an existing set of assertions by adding a jar file. It may connect to any database using the JDBC protocol, where the driver may also be added to the existing driver set without recompiling.

The creation of ETL jobs for importing data into a MySQL database used Talend Open Studio for data integration (TOS), with a calling web service for data refresh and validation using Java. The project included the creation of a data extraction mechanism into a flat-file accordingly to the Polish credit office information system (BIK) format.

While preparing ETL jobs, I discovered that the specifications delivered by businesses are in a constant, predictable format (.docx document). Based on such documents, we were about to prepare ETL job definitions using the Informatica PowerCenter tool. I created a Java program that took the input file and automatically generated a job definition in Informatica XML format, which was easily consumed by the PowerCenter tool. The outcome of that process was that we managed to shorten the process creation from three-four weeks down to a few hours since we eliminated human errors while defining the jobs, such as typos and missed clicks. The tool also provided basic definition validation that allowed one to find documentation bugs in generation time.