Publication
Turn Chaos Into Profit: Understanding the ETL Process
https://www.toptal.com/database/etl-process-in-data-warehouse
Alexandre is available for hire
Hire AlexandreAlexandre Wanderer
Verified Expert in Engineering
Database Developer
Location
San Diego, CA, United States
Toptal Member Since
June 18, 2020
Alexandre is a database and data migration specialist and a leader with over two decades of professional experience. He has worked for clients in industries like finance/trading and automotive. Alexandre's passion for software and technology drives his work ethic and development style.
Portfolio
System Inc.
Business Intelligence (BI), SQL, Google Analytics, Business Analysis, Retool...
Volvo Car USA
Microsoft Power BI, Database Architecture, Business Intelligence (BI)...
CTL Recovery Ltd.
SQL, SQL Server DBA, Data Architecture, Stored Procedure...
Experience
Availability
Part-time
Preferred Environment
Database Architecture, ETL, Data Migration, Database Modeling, Database Administration (DBA), PL/SQL, SQL, Databases
The most amazing...
...project I've worked on is an online conference for trading automation with more than 30,000 attendees and an ROI of 900%.
Work Experience
Business Analyst | BI Consultant
2023 - 2023
System Inc.
- Developed key metric dashboards with 12 key indicators (ARR, sign-ups, drop-offs, activations, etc.) to empower data-driven decisions for a new product launch.
- Integrated Stripe, Retool, and Pendo seamlessly into the core system.
- Oversaw a product launch process with 1,000+ daily new activations.
Technologies: Business Intelligence (BI), SQL, Google Analytics, Business Analysis, Retool, Stripe, Mobile, JavaScript, APIs, Data Cleaning, Data Aggregation
Database Engineer | BI Developer
2020 - 2022
Volvo Car USA
- Provided data for BI systems' decision-making, pulling data from different relational data sources into a dimensional modeling database (DW).
- Used Databricks (Spark, SQL, Python, Hadoop) to create data pipelines to efficiently load data from various sources while ensuring its dependability and consistency.
- Developed a bulletproof ETL process to populate the company data warehouse from the data lake with transformed data, looking for reliability and high availability.
- Reduced the response time in ETL issues with a data quality system to guarantee high availability and integrity. Inconsistencies are fixed automatically, and the team is alerted to fix the other ones. It all occurs before users even know.
- Managed to load the ETL process up to 100+ million rows daily with redundancy, making the data always available. The developers focused on what was more important instead of wasting time fixing bugs.
- Performed Power BI dashboards and dataflows development and integration.
- Used Retool to create and maintain ad-hoc queries.
- Implemented ETL automation routines with SSIS, Python, Stored Procedures, and SQL Agents.
Technologies: Microsoft Power BI, Database Architecture, Business Intelligence (BI), Data Modeling, Data Warehouse Design, Data Warehousing, Data Architecture, Azure Databricks, Retool, SQL Server Integration Services (SSIS), Python, Data Analytics, BI Reporting, Databricks, PySpark, Azure, Hadoop, Amazon EC2, Amazon S3 (AWS S3), Stored Procedure, Data Manipulation Language (DML), T-SQL (Transact-SQL), Data Cleaning, Data Aggregation, Data Lakes, Performance Tuning, Optimization, Database Optimization, Database Migration
MS SQL Server Database Administrator
2020 - 2021
CTL Recovery Ltd.
- Developed maintenance routines to keep the databases up and running.
- Implemented indexing and tunning routines to improve the database and systems performance constantly.
- Added 200,000+ documents/spreadsheets into the database with the FILESTREAM indexing feature, providing advanced real-time search in the entire company's document collection.
Technologies: SQL, SQL Server DBA, Data Architecture, Stored Procedure, Data Manipulation Language (DML), T-SQL (Transact-SQL), Data Cleaning, Data Aggregation, Performance Tuning, Optimization, Database Optimization, Database Migration
Senior Database Developer
2010 - 2020
Focalise Educational
- Developed data integration with the Brazilian stock market to generate customer stock prices.
- Created real-time data integration across multiple platforms using Zapier and Integromat.
- Helped to achieve a return on investment (ROI) of 900% and 660% on an online conference for www.conarobo.com.br, on the first and second editions, respectively.
- Built the whole system to provide real-time information about the stock market to customers.
- Implemented digital advertising campaigns for lead generation, content creation, and sales funnels, generating thousands of leads and sales.
- Managed content creation projects generating thousands of leads and sales on Facebook and YouTube.
- Created sales funnels with high-quality content and offers, remarketing, one-on-one conversations via chatbot, email marketing, and CRM integration.
- Developed a business intelligence application combining information from Facebook Ads, Google Ads, and a third-party payment gateway. Used SQL Server database, SSAS, and SSIS, including cubes, measures, dimensions, DAX, MDX, and dimensional modeling.
- Developed dashboards in Power BI for marketing and financial departments. The dashboards included lead generation, top three traffic sources, top 10 ads, daily sales, ad investment, and more.
- Developed several expert advisors (EAs) in MQL (Metaquotes) for customers and personal use. Implemented multiple servers in the cloud to support dozens of automated strategies operations.
Technologies: Microsoft Power BI, Business Intelligence (BI), SQL, SQL Server DBA, Databases, Data Engineering, Data Pipelines, RDBMS, MySQL, Data Architecture, MQL5, MQL, Stored Procedure, Data Manipulation Language (DML), T-SQL (Transact-SQL), Data Cleaning, Data Aggregation, Data Science, Venture Capital, Data Lakes, Startups, Performance Tuning, PL/SQL Tuning, Optimization, Database Optimization, Database Migration
Senior Database Architect
2007 - 2019
Brivia Digital
- Developed systems for different segments like automotive, wine, shoes, and international trade.
- Installed, managed, and administered dozens of databases in different clients at the same time.
- Played a lead role in planning, testing, and development.
- Worked as a Microsoft SQL and Oracle Database administrator tuning performance in different database sizes.
- Developed data warehouses to integrate different data sources using ETL—SSIS.
- Developed business intelligence applications and cubes (dimensions, pivot, measures).
- Created dashboards in Microsoft PowerBI for sales, marketing, and production departments. Example dashboards included lead generation, weekly revenue, and top five revenue-generating customers.
Technologies: ETL, Microsoft SQL Server, Oracle, SQL, Databases, Data Engineering, Data Pipelines, RDBMS, Data Warehousing, Data Architecture, Visual Basic, Stored Procedure, Data Manipulation Language (DML), T-SQL (Transact-SQL), Data Cleaning, Data Aggregation, Data Lakes, Performance Tuning, PL/SQL Tuning, Optimization, Database Optimization, Database Migration
Founder | Software Engineer | Project Manager
1999 - 2007
WBuild Technology
- Played a lead role in planning, testing, and development.
- Managed commercial, financial, and production departments.
- Managed information technology projects such as an international business ERP.
- Executed research to study the competition and develop new products.
Technologies: Project Management, PL/SQL, SQL, Oracle RDBMS, Databases, Data Engineering, Data Pipelines, RDBMS, Data Warehousing, Data Architecture, Visual Basic, Stored Procedure, Data Manipulation Language (DML), Data Cleaning, Data Aggregation, Startup Funding, Venture Funding, Startups, Performance Tuning, PL/SQL Tuning, Optimization, Database Migration
SQL Developer
1995 - 1999
Azaleia Shoe Company
- Led database design, administration, architecture, and SQL development.
- Headed real-time data migration from different mobile systems to a centralized Oracle database.
Technologies: Oracle Designer, Oracle Reports, Oracle Forms, Oracle RDBMS, SQL, Databases, Data Engineering, Data Pipelines, RDBMS, Data Architecture, Visual Basic, Stored Procedure, Data Manipulation Language (DML), Data Cleaning, Data Aggregation, PL/SQL Tuning, Optimization, Database Optimization, Database Migration
Experience
Steel Plant Production Management System | Gerdau, Inc.
A system to manage the distribution of raw materials (iron, oil, stone) into different plants to produce steel products. The system uses SQL Server and was integrated with schedule production systems. The main function was to plan the availability of raw materials on each power plant.
International Trade ERP
An international trade ERP in Oracle that helps companies to export/import goods worldwide. I worked as a product manager, database architect, and database administrator. Led the development team and helped to create the support team to assist customers in installing and using the system.
Agriculture Equipment Tests | AGCO, Corp.
Remote system to collect information from harvesters (and other types of equipment) in farms and field operations around the world. Afterward, the information is sent to be analyzed in the company headquarters.
Several small databases in SQL Server were used in mobile equipment and the data was synchronized with a central database, and then analyzed by other systems.
Several small databases in SQL Server were used in mobile equipment and the data was synchronized with a central database, and then analyzed by other systems.
Zapier Integration
Among all integrations I have already developed in Zapier, I worked on a chatbot integration for a webinar subscription. The solution allowed access to an API to make the reservation in the Webinarjam platform, capture the confirmation link, shorten the link, send it back to the customer and then schedule a series of reminders to be sent to users before the webinar. The integration with Zapier also allowed sending information to other platforms as a customized internal system, Google Sheets, and an email marketing platform.
Visual Basic Scale Integration
I worked on an integration with precision scale application for a shoe factory laboratory to test the raw materials before using it in the factory. The application was developed in Visual Basic using direct communication with the scale through VB components.
BI Spreadsheets Integration
I developed some complex data integration between spreadsheets and different systems using advanced VBA macros. The spreadsheets are connected to different database sources—namely SQL Server and Oracle—and are used both as source and destination data.
Marketing Business Intelligence - Focalise
Business Intelligence platform for digital marketing projects.
I developed the extraction of data from Facebook, Google Ads (Display, Youtube, etc.). The data is loaded into a SQL Server database, transformed according to some specific business rules, and loaded into fact tables to be used by analytical tools.
I developed dashboards in PowerBI and Excel to provide information to the final users.
Tools used: SSIS, SQL Server, DAX functions, dimensional modeling (fact tables, dimensional tables), and pivots.
I developed the extraction of data from Facebook, Google Ads (Display, Youtube, etc.). The data is loaded into a SQL Server database, transformed according to some specific business rules, and loaded into fact tables to be used by analytical tools.
I developed dashboards in PowerBI and Excel to provide information to the final users.
Tools used: SSIS, SQL Server, DAX functions, dimensional modeling (fact tables, dimensional tables), and pivots.
Skills
Languages
Visual Basic, Visual Basic for Applications (VBA), Excel VBA, SQL, MQL5, T-SQL (Transact-SQL), Data Manipulation Language (DML), Stored Procedure, MQL, MDX, JavaScript, Python, PHP
Frameworks
Hadoop
Libraries/APIs
PySpark, Stripe
Tools
Microsoft Power BI, Google Analytics, Zapier, Facebook Ads Manager, Microsoft Excel, Microsoft Access, Advertising Tools & Platforms, Retool, Shell, Oracle Forms, Oracle Reports, Oracle Designer
Paradigms
Dimensional Modeling, OLAP, Business Intelligence (BI), Database Design, ETL, Data Science
Platforms
Oracle, Databricks, Azure, Amazon Web Services (AWS), Linux, Amazon EC2, Mobile
Storage
Oracle SQL, Databases, MySQL, Azure SQL, SQL Server DBA, PostgreSQL, Database Architecture, Database Modeling, PL/SQL, Oracle PL/SQL, PL/SQL Developer, Data Integration, SQL Performance, SQL Server Integration Services (SSIS), Data Pipelines, RDBMS, SQL Stored Procedures, Oracle DBA, Microsoft DBA, Relational Databases, Data Lakes, Database Migration, SQL Server Analysis Services (SSAS), Database Administration (DBA), Microsoft SQL Server, Database Performance, Amazon S3 (AWS S3), Azure Queue Storage, Oracle RDBMS
Other
DAX, Multidimensional Expressions (MDX), Data Visualization, Facebook Ads, ActiveCampaign, Lead Generation, Facebook Video Ads, Facebook Banner Ads, Digital Advertising, Performance Tuning, Data Modeling, Database Optimization, CSV, Excel Expert, Data Engineering, Data Handling, Finance, Data, CSV File Processing, Data Warehouse Design, Data Warehousing, Data Architecture, CSV Export, CSV Import, Data Analysis, Data Manipulation, APIs, Data Analytics, Data Cleaning, Data Aggregation, Startup Funding, Venture Funding, Venture Capital, Startups, PL/SQL Tuning, Optimization, Oracle Performance Tuning, Data Migration, Azure Databricks, BI Reporting, Business Analysis
Industry Expertise
Project Management
Education
2019 - 2020
Doctorate Degree in International Business
San Diego University for Integrative Studies - San Diego, CA, USA
2015 - 2018
Master's Degree in International Business
Southern States University - San Diego, CA, USA
1995 - 2000
Bachelor's Degree in Computer Science
Universidade Feevale - Novo Hamburgo, RS, Brazil
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring