Erick is available for hire
Hire ErickErick Ferreira Campos
Verified Expert in Engineering
Data Engineer and Developer
São Paulo - State of São Paulo, Brazil
Toptal member since September 20, 2024
Bio
Erick is an experienced data engineer skilled in designing and maintaining scalable data pipelines, ETL/ELT, data warehousing, and modeling, with cloud expertise. He optimizes data workflows for performance, collaborating effectively to solve complex data challenges. Erick is versatile and transitions from marketing, blending technical skills with insights into customer behavior and business needs.
Portfolio
Minsait (an Indra company)
Hadoop, Apache Hive, Apache Sqoop, Microsoft SQL Server, Shell Scripting...
Accenture
Hadoop, Apache Hive, Apache Sqoop, Microsoft SQL Server, Shell Scripting...
BD Intelligence
Amazon Web Services (AWS), Shell, Python 3, Flask, APIs, Microsoft SQL Server...
Experience
- P&L Management - 12 years
- Strategic Planning - 10 years
- Data Engineering - 5 years
- Shell - 5 years
- Python 3 - 5 years
- Amazon Web Services (AWS) - 3 years
- Hadoop - 2 years
- PySpark - 2 years
Availability
Part-time
Preferred Environment
Hadoop, Amazon Web Services (AWS), Python, APIs, PySpark, SQL, Google Cloud Platform (GCP), Linux, Shell, BigQuery
The most amazing...
...thing I've deployed is 12 ETLs in a single PI for a major telecom, including fixes, adaptations, and new processes.
Work Experience
Senior Data Engineer
2024 - PRESENT
Minsait (an Indra company)
- Enhanced the Financial Squad's critical processes with real-time alerts, reducing response times to a maximum of 24 hours. This bolstered reliability and significantly reduced report failures, ensuring accurate financial data handling.
- Refactored a critical, longstanding ETL, integrating new data sources and reviewing data lineage. Streamlined operations reduced unnecessary access, drastically cut processing times, and enhanced data reliability and security.
- Resolved incidents across diverse technology stacks, including Scala, legacy shell scripts, T-SQL, relational database management system (RDBMS), PySpark, and Hadoop. Maintained system stability and ensured continued SLA compliance.
Technologies: Hadoop, Apache Hive, Apache Sqoop, Microsoft SQL Server, Shell Scripting, Automation, Orchestration, Python 3, Spark, Scala, Oracle Database, Scrum, Cloudera Data Platform, HDFS, Google Cloud Platform (GCP), BigQuery, ETL, Data Warehousing, Data Warehouse Design, Analytics, Analytical Thinking, Data Modeling, Database Modeling, SQL, Git, Data Engineering, Data Pipelines
Senior Data Engineer
2023 - 2024
Accenture
- Maintained a consistent pace of one feature per sprint during the crucial migration from Cloudera Data Hub (CDH) to Data Platform (CDP), significantly contributing to the project’s on-time completion and enhancing system reliability and performance.
- Initiated and maintained robust ETL processes and database integrations in a big data environment. Oversaw six major job chains with 60+ individual jobs, enhancing critical business processes such as invoicing, consumer alerts, and revenue analysis.
- Promoted within six months to lead the central serving squad, handling broader technical contributions, managing significant incidents, and enhancing core data solutions. Improved system reliability and operational efficiency across the company.
Technologies: Hadoop, Apache Hive, Apache Sqoop, Microsoft SQL Server, Shell Scripting, Automation, Orchestration, Python 3, Spark, Scala, Oracle Database, Scrum, Cloudera Data Platform, HDFS, Google Cloud Platform (GCP), BigQuery, Data Warehousing, Data Warehouse Design, Analytics, Analytical Thinking, Data Wrangling, SQL, Git, Data Engineering, Databases, Data Pipelines
Consultant
2020 - 2023
BD Intelligence
- Developed interactive dashboards for an investment firm, enabling enhanced visualization of client portfolios, tracking profitability and losses, and improving strategic planning and client services.
- Established a database for an automation solutions provider, integrating Omie ERP and Bitrix24 CRM. Automated reporting, created sales and inventory dashboards, enhanced security, and trained staff for better decision-making.
- Led technical development for a startup marketplace, implementing a CI/CD pipeline with Git and Netlify. Managed an AWS-hosted database integrated with Shopify. Oversaw the entire tech stack, ensuring robust development and operational workflows.
Technologies: Amazon Web Services (AWS), Shell, Python 3, Flask, APIs, Microsoft SQL Server, SQL, Apache Sqoop, Snowflake, MySQL, PostgreSQL, Apache Kafka, AWS Glue, AWS Lambda, Matplotlib, Orchestration, Analytics, Analytical Thinking, Data Warehousing, Data Modeling, Database Modeling, Data Wrangling, Data Engineering, Databases, Docker, Data Pipelines
Product Manager
2017 - 2020
Solutions 2 GO
- Led the creation of a business intelligence (BI) area, developing ML models for demand curves, risk analysis, and sales forecasting. Enhanced decision-making with interactive dashboards to monitor sales and financial metrics.
- Spearheaded the release of two Call of Duty titles in Brazil, achieving extraordinary day-one sales figures and establishing a strong market presence.
- Managed Blu-ray production and distribution in Brazil, conducted viability assessments, acquired new licenses, and developed marketing plans, enhancing game title performance and strategic partnerships.
Technologies: Strategic Planning, Business Development, SQL, Python, Microsoft SQL Server, P&L Management, Forecasting, Microsoft Excel
Brand Manager
2009 - 2016
Hasbro Inc
- Led multiple brand launches in Brazil, including Nerf and Transformers, and product lines for franchises like Avengers, Spider-Man, and Captain America, coordinating strategic planning and market analysis with global teams.
- Was chosen to lead LATAM BI unification as Brazil's representative. Standardized tools and automated data integration for sell-in/sell-through and market forecasts, streamlining processes across Latin America.
- Restored profitability to the gaming product line in one year through comprehensive market analysis, strategic restructuring, and cost-saving measures, significantly boosting financial performance.
Technologies: Excel VBA, Microsoft Power BI, SQL, Microsoft SQL Server, Strategic Planning, Product Management, P&L Management, Forecasting
Experience
Flask API
https://github.com/erick-efc/simple_local_flask_rest_apiA Flask-based REST API designed to manage historical data through comma-separated value (CSV) uploads. It efficiently receives and stores data in a new database and supports batch inserts of up to 1,000 rows per request, facilitating streamlined data processing and management.
Data Architecture Lead for Marketplace Platform
Led the technical direction and developed key APIs for a startup marketplace, integrating a database with Shopify APIs hosted on AWS. Implemented and managed a CI/CD pipeline, overseeing deployments through Netlify. Collaborated closely with the front-end team to ensure seamless integration between back-end services and the user-centric, reels-like shopping experience, enhancing overall system functionality.
Data Systems Architect for Automation Solutions Provider
Established an integrated database system that consolidated data from Omie ERP and Bitrix CRM, enhancing operational efficiencies for a company specializing in automated curtain and blind solutions. I developed and automated reporting processes to provide real-time insights into sales, inventory, and customer relationship management (CRM) activities. I also implemented advanced security protocols and backup solutions to safeguard critical data. I conducted comprehensive training sessions for employees, empowering them to leverage the new system for improved data-driven decision-making and dashboard utilization.
Education
2020 - 2022
Master's Degree in Business Administration
University of São Paulo - São Paulo, Brazil
2005 - 2009
Bachelor's Degree in Advertising and Marketing
Universidade Mackenzie - São Paulo, Brazil
Certifications
JANUARY 2023 - PRESENT
ETL and Data Pipeline with Shell, Airflow, and Kafka
Coursera
DECEMBER 2022 - PRESENT
Hands-on Introduction to Linux Commands and Shell Scripting
Coursera
DECEMBER 2022 - PRESENT
Relational Database Administration (DBA)
Coursera
DECEMBER 2022 - PRESENT
Data Engineer Foundations Specialization
Coursera
SEPTEMBER 2022 - PRESENT
Data Manipulation with Pandas
DataCamp
Skills
Libraries/APIs
PySpark, Matplotlib, Pandas
Tools
Git, Microsoft Excel, GitHub, Shell, BigQuery, Microsoft Power BI, Apache Sqoop, AWS Glue, NGINX, Apache Airflow
Storage
Databases, Data Pipelines, MySQL, Apache Hive, HDFS, Microsoft SQL Server, PostgreSQL, Database Architecture, Database Modeling
Languages
Python, SQL, Python 3, Excel VBA, Snowflake, Scala
Frameworks
Hadoop, Flask, Spark
Paradigms
Scrum, Automation, ETL
Platforms
Amazon Web Services (AWS), Google Cloud Platform (GCP), Linux, Apache Kafka, AWS Lambda, Oracle Database, Cloudera Data Platform, Amazon EC2, Shopify, Netlify, Docker
Other
Strategic Planning, Product Management, Business Development, P&L Management, Forecasting, Business Administration, Data Engineering, Excel Expert, Version Control, Data Warehousing, Analytics, Analytical Thinking, Data Modeling, APIs, Data Science, Web UI, SEO Tools, Economics, Financial Planning & Analysis (FP&A), Shell Scripting, Orchestration, CI/CD Pipelines, Team Management, Bitrix24, Relational Database Design, Data Warehouse Design, Data Wrangling
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring