Thiago V Ferreira, Developer in São Paulo - State of São Paulo, Brazil
Thiago is available for hire
Hire Thiago

Thiago V Ferreira

Verified Expert  in Engineering

Data Engineering Developer

Location
São Paulo - State of São Paulo, Brazil
Toptal Member Since
March 25, 2022

Thiago is an IT expert with extensive knowledge and experience in different areas gathered over ten years. He is proficient in implementing and maximizing challenges and ideas. He is highly self-motivated and results-driven to ensure all tasks are completed. Thiago has mastered his skills in data management, data warehousing, data lake, delta lake, lake house, SQL, MPP DB, ETL/ELT, Python, Databricks, Azure Data Factory, Azure Functions, Azure Synapse Analytics, SSIS, Talend, etc.

Portfolio

Keyrus
Azure, Azure Data Factory, Azure Synapse Analytics, Azure Functions...
Keyrus
Dedicated SQL Pool (formerly SQL DW), Azure SQL Data Warehouse, Azure Data Lake...
Keyrus
Microsoft Power BI, SQL Server Reporting Services (SSRS), ASP.NET...

Experience

Availability

Part-time

Preferred Environment

Azure, Microsoft

The most amazing...

...project I've built is a generic event-driven data processing framework on Azure based on YAML and JSON files, capable of performing any data processing task.

Work Experience

Technical Data Architect

2020 - 2022
Keyrus
  • Gathered requirements from users to design and implement solutions according to business needs.
  • Built a generic event-driven data processing Azure framework based on settings text files capable of performing any data processing task such as extracting, transforming, and loading, also orchestrating full data pipelines in over 64 countries.
  • Created new delta lake architecture in the cloud using Azure.
  • Automated manually time-consuming data tasks with Azure Databricks.
Technologies: Azure, Azure Data Factory, Azure Synapse Analytics, Azure Functions, Azure Data Lake, Azure Queue Storage, Azure Databricks, Python, Azure DevOps

Data Engineer

2019 - 2020
Keyrus
  • Gathered requirements from users to design and implement solutions according to business needs.
  • Built MPP data models to store data from different sources and diverse countries.
  • Created a semantic layer to deliver information on data visualization tools for more than 50 countries.
  • Developed the global P&L KPIs data model and automated ELT processes. Performed global data architecture assessment, data ingestion gaps analysis, and ELT processes monitoring.
Technologies: Dedicated SQL Pool (formerly SQL DW), Azure SQL Data Warehouse, Azure Data Lake, Talend, Apache Hive, Azure HDInsight, Microsoft SQL Server

Technical Lead

2016 - 2019
Keyrus
  • Built and migrated a reporting service and custom .NET dashboards environment to Microsoft Power BI.
  • Successfully implanted a significant data appliance and deployed strategic solutions applying predictive analysis concepts, machine learning, and data discovery.
  • Performed data modeling, code reviews, technical design, and mentoring.
Technologies: Microsoft Power BI, SQL Server Reporting Services (SSRS), ASP.NET, Microsoft Parallel Data Warehouse (PDW), C#.NET, Cloudera, Hadoop, HDFS, Apache Hive, Apache Impala, Spark, SharePoint 2013, Microsoft, Microsoft SQL Server

Senior Software Engineer

2015 - 2016
Keyrus
  • Led two different teams: the geographic information system and the SharePoint development team.
  • Effectively implemented a BI geographic web portal for six different areas inside the organization.
  • Interacted extensively with developers, quality assurance engineers, and project teams regarding scheduling, requirements, design, implementation, and testing.
Technologies: C#.NET, ASP.NET, Microsoft Parallel Data Warehouse (PDW), Google Maps API, SharePoint 2013, JavaScript, jQuery, HTML5, Microsoft SQL Server

SharePoint and .NET Consultant

2014 - 2015
Arbit
  • Assigned to UnitedHealth Group Brazil, where I held functions of strategizing environments and solutions.
  • Migrated the current system from SharePoint 2010 to SharePoint 2013. Restructured various existing services and applications, including the reporting service and .NET applications.
  • Architected and developed a geographic information system (GIS) application integrated with the Google Maps API.
Technologies: SharePoint, C#.NET, ASP.NET, HTML5, CSS, jQuery, JavaScript, Microsoft SQL Server, Google Maps API

Lead Software Engineer

2012 - 2014
Dot-Insight
  • Acted as SharePoint’s team leader and applied Agile development methodologies such as Scrum. Proposed impediments alternatives, assigned tasks, and reallocated resources.
  • Developed a custom HR people movement form hosted in SharePoint and developed custom workflows for each type of movement.
  • Designed architecture solutions and gathered requirements from customers.
  • Created a shipping price calculator algorithm to guarantee that we always had the best shipping price.
Technologies: SharePoint 2013, HTML5, CSS, C#.NET, Microsoft SQL Server, JavaScript, jQuery, WCF Web Services

Azure Data Acquisition Framework

I built this generic event-driven data processing framework based on YAML and JSON files that is capable of performing any data processing task such as extract, transform, and load. It also enables orchestrating full data pipelines in over 64 countries.

Big Data Environment

I successfully designed and implanted from scratch a new Cloudera Big Data Appliance. I deployed strategic solutions applying concepts of predictive analysis to diseases prevention, machine learning to intercept claims frauds, and data discovery.
2012 - 2015

Bachelor's Degree in Computer Science

Centro Universitário FIEO - São Paulo, Brazil

2006 - 2007

Associate Degree in Software Development

Bradesco Foundation - São Paulo, Brazil

MARCH 2021 - MARCH 2023

Microsoft Azure Data Engineer Associate

Microsoft

MARCH 2021 - PRESENT

Microsoft Certified: Azure Fundamentals

Microsoft

MARCH 2021 - PRESENT

Microsoft Certified: Azure Data Fundamentals

Microsoft

Languages

SQL, T-SQL (Transact-SQL), C#.NET, Python, VB.NET, HTML, JavaScript, CSS, HTML5

Paradigms

ETL, Azure DevOps

Platforms

Azure, Microsoft, Azure Synapse, Azure Functions, Azure SQL Data Warehouse, Databricks, Azure Synapse Analytics, Talend, Dedicated SQL Pool (formerly SQL DW), SharePoint, SharePoint 2013

Storage

Databases, Microsoft SQL Server, Azure SQL, Azure Table Storage, Azure SQL Databases, Azure Queue Storage, Microsoft Parallel Data Warehouse (PDW), Azure Cosmos DB, MariaDB, MySQL, PostgreSQL, Apache Hive, HDFS, SQL Server Reporting Services (SSRS), Database Administration (DBA)

Other

Data Engineering, Programming, Architecture, Azure Data Lake, Azure Data Factory, Azure Databricks, Data Security, Data Architecture, Data, Storage, Algorithms, Networks, Calculus, Networking, Cloud Security, Cloud Services, Cloud Storage, Virtualization, Cloud, Data Analytics, Data Processing, Data Visualization, Azure Stream Analytics, Big Data, WCF Web Services, Data Analysis, Azure Virtual Machines

Libraries/APIs

PySpark, jQuery, Google Maps API

Frameworks

ASP.NET, Hadoop, Spark, ASP.NET MVC

Tools

Microsoft Power BI, Cloudera, Apache Impala, Microsoft Team Foundation Server, Azure HDInsight, SQL Server BI

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring