toptal.com
Contact us: +1.888.604.3188
Arthur Flores Duarte, Data Visualization Developer in Florianopolis - SC, Brazil
Arthur Flores Duarte

Data Visualization Developer in Florianopolis - SC, Brazil

Member since April 23, 2017
Arthur has more than 15 years of experience in software development and system analysis, seven years working with SQL and data analysis. He's experienced with Oracle, BigQuery, Snowflake, and other data sources such as Excel, CSV, and JSON files. He also has a solid background in business intelligence, data analytics, dashboards, ETL, and Python scripts. In addition to excellent relationships with work teams and customers, Arthur is very committed, adaptable, and creative.
Arthur is now available for hire
Hire Arthur

Portfolio

  • Self-employed
    Excel VBA, Data Build Tool (DBT), Prefect, Python, Snowlflake
  • Projeto 22
    Amazon Web Services (AWS), Apache Airflow, Apache NiFi, EMR...
  • Toptal Projects
    Dashboards, Amplitude, Jupyter Notebook, Python, Mode Analytics, BigQuery, SQL

Experience

Location

Florianopolis - SC, Brazil

Availability

Part-time

Preferred Environment

Amazon Web Services (AWS), GitHub, Notepad++, SQL Developer, Windows, AWS

The most amazing...

...dashboard I've designed was for a vehicle sharing company, displaying a map containing the user adoption related to parking places, using geo location data.

Employment

  • Analytics Engineer

    2020 - PRESENT
    Self-employed
    • Worked 100% remotely for a US-based company, providing services for customers from San Francisco Bay Data as an analytics engineer.
    • Created automated custom data reports using Python and Excel VBA scripts.
    • Extracted data for reports from Presto DB/Snowflake using complex SQL scripts.
    • Used a data build tool (DBT) to transform and model raw data (ELT).
    • Developed Python scripts for Prefect cloud to automate and orchestrate data reports.
    • Integrated data between Snowflake and Salesforce to generate reports using Bulk API.
    Technologies: Excel VBA, Data Build Tool (DBT), Prefect, Python, Snowlflake

  • Data Engineer

    2020 - 2020
    Projeto 22
    • Worked as a part-time data engineer, supporting the data squad on a new data lake project for a vehicle sales company (WebMotors).
    • Supported the data engineering team providing AWS resources: EC2, S3, VPC, and RDS (Aurora PostgreSQL) and Redshift.
    • Developed Cloud Formation templates to automate AWS resources provisioning.
    • Deployed an Apache NIFI cluster for data ingestion processing using Zookeeper and NiFi Registry.
    • Integrated AWS DMS (data migration service) mapping tables from SQL Server and Aurora MySQL to S3 buckets in parquet files.
    • Deployed an Apache Airflow and EMR cluster to support complex data processing.
    • Built CloudWatch alarms for servers and applications monitoring.
    • Used Lambda and Boto3 to automatically stop/start EC2 and RDS instances according to schedule, reducing costs.
    • Developed Python scripts for several purposes, such as databases stress tests.
    Technologies: Amazon Web Services (AWS), Apache Airflow, Apache NiFi, EMR, Document Management Systems (DMS), PostgreSQL, Relational Database Services (RDS), Amazon Virtual Private Cloud (VPC), AWS S3, AWS EC2, AWS

  • Data Analyst - Quant Collective/Spin

    2019 - 2020
    Toptal Projects
    • Analyzed data using complex SQL queries on Google BigQuery.
    • Presented data analytics reports for managers using dashboards from Mode Analytics.
    • Defined business metrics to support and define company OKRs.
    • Provided reports for monitoring and decision support for different areas such as growth, product, and operations.
    • Worked on geo-spatial analysis for scooters and generated map charts using Python and Jupyter notebook.
    • Supported A/B tests to analyze adoption for product features.
    Technologies: Dashboards, Amplitude, Jupyter Notebook, Python, Mode Analytics, BigQuery, SQL

  • Solution Integration Architect

    2018 - 2019
    Optiva Inc.
    • Worked 100% remotely as part of a global professional services team (English and Spanish speaking teams).
    • Integrated and configured DCRM and portals for telecom customers in different countries.
    • Wrote system integration tests, user acceptance tests, test scenarios, configuration handbooks, user training, and production roll out documents.
    • Analyzed data from different CRM environments, exporting and comparing data into Excel using formulas such as vlookup, to troubleshooting missing configuration parameters.
    Technologies: BSS, Portals, ASPX, Microsoft Dynamics CRM, Microsoft SQL Server

  • Data Analyst/Technical Leader

    2011 - 2018
    Wedo Technologies
    • Worked with large volumes of data. Found revenue leakages and trends between telecom systems, applying data analytics techniques.
    • Integrated several telecom systems into RAID ETL tool, reading different data sources(Oracle, SQL Server, Excel, CSV, ASN1), containing telecom events and customer data.
    • Performed Oracle DB, SQL performance tuning, procedures (PL/SQL), and wrote Python and Shell scripts.
    • Provided system analysis and solution design documentation, scope and architecture definition, and technical proposals for sales.
    • Designed user reports, dashboards, and KPIs.
    • Oversaw unit tests, integration tests, UAT, and production rollout. Completed technical and functional training for customers and teams.
    • Provided technical leadership and project management in different projects.
    • Worked on various projects for telecommunications customers in different countries, such as Brazil, Chile and Peru.
    Technologies: PL/SQL, Business Intelligence (BI), ETL, Python, Shell, Unix, RAID, Microsoft SQL Server, Oracle

  • Developer

    2009 - 2011
    Seventh
    • Contributed to Delphi programming (MVC, object-oriented) for video surveillance software.
    • Integrated different kinds of devices such as IP cameras and video encoders.
    • Led network protocol integration (CGI, SOAP, HTTP, TCP, RTSP).
    • Reverse-engineered protocols using Wireshark.
    • Decoded video and audio using VLC libs.
    Technologies: CGI, SOAP, Network Protocols, TCP/IP, Delphi

  • Developer

    2008 - 2009
    ACCL Gestao Empresarial
    • Served as a Delphi developer for business management and budget software.
    • Provided Firebird DB modeling, stored procedures, and triggers.
    • Implemented Scrum methodology for the development team.
    • Translated technical documents from English to Portuguese.
    • Developed software interfaces based on multi-tier applications.
    Technologies: Firebird, Delphi

  • Trainee/System Analyst

    2004 - 2007
    Alliance Consutoria
    • Developed software with Uniface language (Compuware).
    • Integrated databases including Oracle, SQL Server, and DB2.
    • Contributed to development using agile methodologies.
    • Participated in CMMI (level 2) project implementation.
    Technologies: IBM Db2, Microsoft SQL Server, Oracle, Uniface

Experience

  • Data Analyst for a Toptal Client

    Designed a geospatial dashboard (map) for a vehicle sharing company, displaying the user adoption and behavior change related to defined parking places.

    The data was extracted made using SQL and using Google BigQuery geospatial libs. The dashboard was made using Mode, Python, and Jupyter Notebook.

Skills

  • Languages

    SQL, Delphi, Snowflake, Excel VBA, Python

  • Storage

    PL/SQL, Databases, Relational Databases, ANSI SQL, Oracle SQL, Oracle DBMS, AWS S3, Microsoft SQL Server, Oracle PL/SQL, SQL Developer, SQL Server 2012, MySQL, PostgreSQL

  • Other

    Dashboards, Data Visualization, Data Analysis, Analytics, Visualization, Telecom Business Support Systems (BSS), Revenue Assurance, Key Performance Indicators (KPIs), BI Reports, Data Analytics, Google BigQuery, Mode Analytics, Data Modeling, Performance Tuning, Data Engineering, TCP/IP, Network Protocols, Amplitude, Relational Database Services (RDS), Document Management Systems (DMS), EMR, Prefect, Snowlflake, Data Build Tool (DBT), Shell Scripting, Dynamics CRM 365, AWS

  • Tools

    BigQuery, Microsoft Excel, Notepad++, GitHub, Microsoft Dynamics CRM, Shell, Amazon Virtual Private Cloud (VPC), Apache Airflow, Microsoft Power BI, Jupyter, Tableau

  • Paradigms

    Dimensional Modeling, ETL, Business Intelligence (BI)

  • Platforms

    Oracle, Salesforce, Unix, Windows, Amazon Web Services (AWS), AWS EC2, Jupyter Notebook

  • Libraries/APIs

    Tray.io, Pandas, NumPy

Education

  • Master of Business Administration (MBA) degree in Project Management
    2011 - 2012
    FGV - Fundacao Getulio Vargas - Florianopolis, SC, Brazil
  • Bachelor's degree in Computer Engineering
    2002 - 2007
    Sao Paulo Metodista University - Sao Bernardo do Campo, SP, Brazil

To view more profiles

Join Toptal
Share it with others
Hire the top 3% of freelance developers TM