Carlos is available for hire
Hire CarlosCarlos Andrés Castaño Varela
Verified Expert in Engineering
Data Developer
Location
Barranquilla - Atlantico, Colombia
Toptal Member Since
October 7, 2022
Carlos is an experienced data engineer who leverages his previous manufacturing industry, eCommerce, and startup knowledge to efficiently deliver meaningful and high-quality solutions to clients. Carlos has a big passion for data, is eager to solve new challenges, and is always available to help.
Portfolio
Molyworks Materials Corp
Microsoft Power BI, Microsoft SQL Server, Azure, Azure SQL Databases...
EPAM Systems
ETL Tools, Tableau, Python, Data Quality, Data Pipelines, ETL, Dashboards...
Water UX, Inc
Data Engineering, Apache Airflow, Amazon Athena, Redshift, Data Pipelines, ETL...
Experience
Availability
Part-time
Preferred Environment
Windows Subsystem for Linux (WSL), Ubuntu, MacOS, Amazon EC2, Apache Airflow, Amazon RDS, Amazon QuickSight, Tableau, Visual Studio Code (VS Code), Git
The most amazing...
...thing I've developed is a complete end-to-end data solution for a client to bring visibility and a new business idea.
Work Experience
Power BI Developer
2022 - PRESENT
Molyworks Materials Corp
- Designed and implemented a data warehouse using Azure SQL Database (based on MS SQL Server).
- Built 10+ pipelines in Azure Data Factory as an ETL process to extract data from different sources like Excel files, MS SQL Databases (on-prem), and Gsheets.
- Created 10+ MS Power BI reports based on data stored in the DWH that provided insights into the process.
Technologies: Microsoft Power BI, Microsoft SQL Server, Azure, Azure SQL Databases, Azure Data Factory, Azure Blobs, DAX, SharePoint, Reporting
Senior Software Engineer
2022 - PRESENT
EPAM Systems
- Developed several pipelines in the client's ETL tool to provide information for further data analysis and quickly gained expertise on the client's infrastructure.
- Created and updated several Tableau dashboards based on previous pipeline work.
- Designed complex SQL queries to extract information from several data sources in preparation for reporting.
Technologies: ETL Tools, Tableau, Python, Data Quality, Data Pipelines, ETL, Dashboards, Business Intelligence (BI), Data Management, SQL, Windows, Visual Studio Code (VS Code), Data Analytics, Data Analysis, Analytics, Data Visualization, Databases, BI Reporting, Data Warehousing, Reporting
Data Engineer
2022 - 2023
Water UX, Inc
- Developed an ETL process for extracting data from a PostgreSQL instance to another using normalization techniques and Apache Airflow.
- Designed and implemented a PostgreSQL database schema for storing normalized data to be used in a web application.
- Created analytical reports based on water consumption data using Python and Pandas.
Technologies: Data Engineering, Apache Airflow, Amazon Athena, Redshift, Data Pipelines, ETL, PostgreSQL, Amazon RDS, Pandas, Reporting
Data Analyst | Engineer
2021 - 2022
LaHaus
- Delivered an end-to-end data extraction, conversion, data quality, loading, and analytics solution to bring visibility to an entire company area.
- Managed ETL data available in different APIs, such as CRM and social networks, to provide insights into the marketing process.
- Used data to create meaningful dashboards to support the decision-making process in the different areas of the company.
- Created a machine learning module and exposed the results in a FastAPI endpoint.
Technologies: Apache Airflow, PostgreSQL, Amazon RDS, Amazon EC2, Python, Tableau, APIs, Snowflake, Git, GitHub, Data Pipelines, ETL, Dashboards, Business Intelligence (BI), Data Management, SQL, Windows, Visual Studio Code (VS Code), Data Analytics, Data Analysis, Analytics, Data Visualization, Databases, BI Reporting, Data Warehousing, Reporting
PrestaShop Developer
2021 - 2021
Freelance
- Executed improvements to the web page loading times with a custom fix to an underperforming third-party module that severely affected user experience.
- Created PrestaShop site stored on cloud location with custom integrations delivering a complete eCommerce solution.
- Developed several customizations on aspects and functionality of the site, including themes, shipping, and pricing.
- Built production and staging environments and a simple CI/CD process for development and tests.
Technologies: PrestaShop, PHP, JavaScript, SQL, Windows, Visual Studio Code (VS Code)
IT Coordinator
2020 - 2021
Acesco Colombia
- Managed high-level contracts of licensing renewal, IT assets procurement, and vendor services, always aiming for the best cost efficiency and maintaining internal client satisfaction.
- Created dashboards, insights, and reports with business data for internal analysis.
- Managed IT and security audits and designed and enforced security policies.
Technologies: Microsoft Power BI, Power Pivot, Dashboards, Business Intelligence (BI), SQL, Windows, Visual Studio Code (VS Code), Data Analytics, Microsoft SQL Server, Data Analysis, Analytics, Data Visualization, Databases, Azure, BI Reporting, DAX, SharePoint, Reporting
Automation Engineer
2011 - 2020
Acesco Colombia
- Commissioned an engineering data storage network for machine automation to provide a ground base for engineering analysis of process variables leveraged for machine failures and unexpected stoppages.
- Assisted in the procurement process of global technology and machines interacting with providers and assured the implementation of up-to-date technologies at the best possible cost.
- Collaborated in the revamping projects of manufacturing process machines as a way of maintaining the ideal state of the company's assets.
Technologies: Siemens PLC, Variable Frequency Drive (VFD), Motion Control
Experience
Data Analytics Web App for the Water Sector in California
A data analysis app for the water sector in California. I was involved in creating an ETL process for the data using Apache Airflow and pandas for normalization and storage in a PostgreSQL AWS RDS instance.
Custom DAX Metrics for a Power BI Chart
A matrix chart built with tailored metrics using DAX and Salesforce data as a data source. This chart was added to an existing dashboard to introduce the opportunity flow metrics for the client's company.
ETL Process for Marketing Data
An Apache Airflow (EC2) and PostgreSQL (RDS) ETL process system stored on AWS for processing marketing data from Facebook API, client data from HubSpot API, and several individual spreadsheets stored in Google Sheets with data quality checks, implementation, and error reporting to generate final tables for analytical purposes.
Random Forest Model FastAPI
A random forest model for pricing prediction with an endpoint to generate results. I was a developer that trained a random forest model after successfully extracting and preparing product pricing data. I created an API-based final model on FastAPI to expose the model's results to the company.
Data Extraction Tool for Process Engineering
A process engineering and automation tool implementation for data acquisition, storage, and analysis. I was the engineer in charge of configuring and commissioning real-time data acquisition software. Configured TCP and UDP raw connections and designed the solution's data storage strategy based on best performance and efficiency.
eCommerce Website
An eCommerce website based on PrestaShop open-source platform written in PHP. I was a developer and integrator of several modules and fixes, starting with theme integrations and template modifications, payment gateway configurations, and third-party shipment modules.
Skills
Languages
SQL, Python, Snowflake, PHP, JavaScript
Libraries/APIs
Pandas, Scikit-learn, TensorFlow
Tools
Microsoft Power BI, Apache Airflow, Tableau, PrestaShop, Git, Power Pivot, GitHub, Amazon QuickSight, Amazon Athena
Platforms
Amazon EC2, Ubuntu, Windows, Amazon Web Services (AWS), Azure, SharePoint, MacOS, Visual Studio Code (VS Code), Salesforce
Storage
Databases, PostgreSQL, Data Pipelines, Microsoft SQL Server, Memcached, Redshift, Azure SQL Databases, Azure Blobs
Other
Windows Subsystem for Linux (WSL), Process Automation, Power Electronics, Projects, Waterfall Methodology, Siemens PLC, Variable Frequency Drive (VFD), Motion Control, ETL Tools, Data Analytics, Dashboards, Data Analysis, Analytics, Data Visualization, BI Reporting, Reporting, Data Scraping, Amazon RDS, APIs, Data Quality, Data Engineering, Data Management, Data Warehousing, Azure Data Factory, DAX, Dash, Networking
Paradigms
PMBOK, ETL, Business Intelligence (BI), Data Science
Education
2016 - 2017
Postgraduate Degree in Engineering Project Management
The University of the North - Barranquilla, Colombia
2005 - 2009
Bachelor's Degree in Electronics Engineering
The University of the North - Barranquilla, Colombia
Certifications
SEPTEMBER 2021 - PRESENT
Data Science for All (DS4A)
Correlation One
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring