Luis is available for hire
Hire LuisLuis Villavicencio
Verified Expert in Engineering
Data Engineering Developer
Location
Montreal, QC, Canada
Toptal Member Since
June 24, 2020
Luis has more than nine years of technical experience as a software engineer, data developer, and data analyst. He has been focusing on big data technologies and machine learning models for the past three years. Luis is a versatile, analytical, and methodical professional.
Portfolio
Intelcom
Snowflake, Python, SQL, JavaScript, Data Governance, Data Engineering...
Consultant
Google Data Studio, Google Cloud Platform (GCP), Python, Keras, Flume...
Muraflex
Pandas, NumPy, Scikit-learn, Python, SAP HANA, SQL, Microsoft Power BI
Experience
Availability
Part-time
Preferred Environment
Google Cloud Platform (GCP), Snowflake, Data Build Tool (dbt), Amazon Web Services (AWS)
The most amazing...
...project I have worked on is a data and ML solution to predict fire events in Montreal.
Work Experience
Senior Data Engineer | Lead Analytics
2020 - PRESENT
Intelcom
- Designed data integration flows using available platforms such as AWS (Lambda, Kinesis firehose, S3, and more), Azure (Data Factory, Azure SQL DB, etc.), Snowflake (SQL, Tasks, Stream, and Pipe), BigQuey, Apache Pulsar (streaming) and DBT.
- Fed the different analytical environments like OPS datamarts, finance, and more.
- Searched continuously for possible improvements to the analytical platform to better support data analytics needs, such as orchestration, architecture, data models, data quality, performance, DataOps, and MLOps.
- Contributed to both technical and user-oriented documentation of reports and metrics.
Technologies: Snowflake, Python, SQL, JavaScript, Data Governance, Data Engineering, Data Build Tool (dbt), ETL, ELT, Microsoft Power BI
Data Engineer Consultant
2016 - PRESENT
Consultant
- Designed a proof of concept for Twitter data analyses and data ingestion using Apache Flume to a Hadoop environment.
- Developed a machine learning model to predict fire events in the city of Montreal. The models were done in Python (Keras) using neuronal networks.
- Designed a proof of concept for an IoT project with data ingestion from different IoT devices to GCP and data visualization using Google Data Studio.
Technologies: Google Data Studio, Google Cloud Platform (GCP), Python, Keras, Flume, Apache Pig, Impala, Apache Hive, Hadoop
Principal Data Engineer
2017 - 2021
Muraflex
- Managed all data and analytics projects. Provided data-architecture design leadership and direction to reach the realization of enterprise goals. Served as a leader for data-transformation initiatives from on-premise to cloud-data technologies.
- Built strong and measurable processes, tools, and engineered data-management solutions to support all data platforms such as data warehouse, lakes, reporting/BI tools, data science, data catalog, data visualization, etc.
- Worked with developers and analysts to understand their daily workloads and suggest techniques and tools for optimization.
- Managed relationships with IT partners and vendors, security, and other teams across the company.
- Worked with data from different sources (SQL, NoSQL, text, Excel, and CSV files) to get business insights and build ETL pipelines.
- Designed and created data models as needed. Served as an expert in SQL and different data-management systems.
- Designed, built, and deployed various Power BI applications, from data extraction to data visualization, providing advanced dashboards and insights about users' activity log, CRM, and ERP system.
- Worked alongside other team members and stakeholders to gather business requirements and design KPIs.
Technologies: Pandas, NumPy, Scikit-learn, Python, SAP HANA, SQL, Microsoft Power BI
BI Consultant | Power Platform
2020 - 2020
Dermalogica
- Created a cost-effective solution to access key reporting and analytics. The solution was based on Microsoft Power Apps with secure access and a multi-device solution. It involved dashboards in Power BI and data connection to SharePoint lists.
- Trained the client with the use of Microsoft Power Apps and the admin portal, so the client was able to do it independently.
- Helped to improve reports on Power BI and provide some guidelines regarding the whole analytics solution.
Technologies: SharePoint, Microsoft Power BI, Microsoft Power Apps
Manager BI
2015 - 2016
CESEL
- Managed the BI initiatives, ensure the task execution and control of the requirements. Managed the stakeholders expectations and led the team that developed a BI platform.
- Coordinated activities throughout the software development life cycle. Prioritized the request from the central operations department.
- Designed a datamart and visualization tools for the business operation of the company.
- Optimized the data architecture, recognize system deficiencies, and implement effective solutions, data warehouse creation.
Technologies: JavaScript, Microsoft SQL Server, MySQL, Oracle, HTML, PHP, Java
Data Analyst
2012 - 2015
CESEL
- Created different dashboards and reports to provide insights about the status of the business operation.
- Presented the insights generated through analyses to all types of audiences in a storytelling format.
- Worked with management to prioritize business and information needs. Proposed and implemented various improvements in business processes, data architecture, and definition of optimal KPIs and visual types.
Technologies: Microsoft SQL Server, MySQL, Oracle, JavaScript, CSS, HTML, PHP
Experience
Bixi Montreal
BIXI Montréal is a public bicycle sharing system serving Montréal, Quebec, Canada.
It was required to provide insights about user behavior and peek usage. This analysis helped to optimize the bike availability and service in the city.
These are some points that were addressed:
- At what moment we have the highest number of rides? (season, day of the week, time)
- What are the busiest bike stations?
- What are the most common starting and destination area? (popular routes)
- Behavior difference between user members and non-members. Route duration and user speed.
It was required to provide insights about user behavior and peek usage. This analysis helped to optimize the bike availability and service in the city.
These are some points that were addressed:
- At what moment we have the highest number of rides? (season, day of the week, time)
- What are the busiest bike stations?
- What are the most common starting and destination area? (popular routes)
- Behavior difference between user members and non-members. Route duration and user speed.
Skills
Languages
SQL, Python 3, Python, Snowflake, PHP, Java, HTML, JavaScript, CSS
Tools
Microsoft Power BI, Git, Apache Impala, Tableau, Apache Sqoop, BigQuery, Microsoft Excel, Tableau Desktop Pro, Microsoft Power Apps, Impala, Flume
Storage
MySQL, Databases, Apache Hive, HBase, NoSQL, PostgreSQL, Microsoft SQL Server
Other
Data Visualization, Data Modeling, Reporting, Machine Learning, Data Engineering, Apache Flume, Google Data Studio, ETL Tools, Data Cleaning, Big Data, Data Migration, Excel Macros, Tableau Server, Data Analysis, Data Build Tool (dbt), Apache Pulsar, Data Governance, ELT
Frameworks
Hadoop
Libraries/APIs
JSON API, REST APIs, PySpark, Scikit-learn, NumPy, Pandas, Keras
Paradigms
Database Design, ETL, Business Intelligence (BI), Data Science
Platforms
Apache Pig, Amazon Web Services (AWS), Jupyter Notebook, Docker, SAP HANA, Visual Studio Code (VS Code), Google Cloud Platform (GCP), Eclipse, SharePoint, Oracle
Education
2006 - 2010
Bachelor's Degree in Engineering
UDEP - Lima - Peru
Certifications
JANUARY 2019 - PRESENT
Data Science and Machine Learning
McGill University