Michael Kooloos
Verified Expert in Engineering
Data Engineer and Software Developer
Michael is an all-around big data, BI, and DWH analytics engineer and architect with over 20 years of experience. He has a quick understanding of the information needs of the business. Michael is experienced in all project phases, from analysis and design to development and end-user training and support. Michael is best in complex environments when technology needs to result in real business value by delivering the right information to the right person at the right time.
Portfolio
Experience
Availability
Preferred Environment
Agile, SQL, Delta Lake, Data Build Tool (dbt), DataHub, Data Analytics, Microservices
The most amazing...
...real-life problem I've solved is a module for predicting and calculating forecast figures for the maintenance of escalators in a big international airport.
Work Experience
Data Analytics Engineer | Architect
Freelance
- Developed a data warehouse using metadata-driven data vault code automation.
- Analyzed requirements for a new corporate dashboard, analyzed data, and created a solution design.
- Developed a data pipeline for monitoring machine logs to detect possible bugs after software upgrades.
- Analyzed and tuned several performance issues, bringing query runtimes from minutes to milliseconds.
- Developed a point-in-time detection of nonconformity of machine constants.
- Led a team of data warehouse developers to develop and implement a mortgage data warehouse.
- Architected a unified product catalog and several pipelines for the synchronization of vendor-specific attributes.
- Implemented a way of working and created guidelines for conceptional data modeling as part of the overall data governance strategy.
- Enabled a way of working and creating guidelines for metadata management as part of the overall data governance strategy.
- Developed a real-time search and analytics platform based on Apache Solr for metal traders and exchanges.
Solutions Architect and Co-founder
BiiT Sourcing Solutions
- Led a team of application developers to develop and implement several cloud-based applications.
- Organized work to meet goals and deadlines while ensuring the technical solution supported the business objectives.
- Designed solutions for our clients on numerous projects, using existing and proven open-source software, components, frameworks, and our products to deliver custom cloud-based solutions.
- Enabled digital transformation of organizations through process optimization and real-time information access to deliver the right information to the right person at the right time.
- Implemented proof of technology for IoT beacon processing for indoor positioning to deliver smart shopping presentations.
Business Intelligence and Data Warehouse Consultant
Freelance
- Designed and developed an open-source enterprise information access platform based on Hadoop (distributed file system and processing), Apache Solr (search engine), and Apache Mahout (machine learning/predictive analytics).
- Built a back-end rule engine for individual training schedule creation.
- Created web-based applications for registering, visualizing, and analyzing individual athlete and team progress for performance, recovery logs, and test results.
- Developed a data warehouse for multiple hospitals for patients, medical cases, transfers, diagnoses, and observations.
Business Intelligence and Data Warehouse Consultant
Scamander Solutions
- Created a data warehouse for alerts/violations derived from city control.
- Designed and developed several semantic layers for end-user presentations for both analytical and operational reporting purposes.
- Built dashboards, custom visualization widgets, and analytical and operational reports for finance, sales, marketing, HR, healthcare, manufacturing, and supply chain.
- Developed a set of triggers and PL/SQL packages to predict and calculate forecast figures for the maintenance of escalators in a big international airport.
- Led a project to implement a data warehouse solution for a big telco provider and the interfacing of product and invoice data to the customer web portal.
Oracle Consultant
Getronics Software Solutions
- Developed customizations and gave third-line technical support in an Oracle Manufacturing environment.
- Analyzed, designed, and developed a custom Oracle system for mailing and registration to support a high output of forms.
- Developed and gave support to a custom Oracle system for order management.
Experience
Prediction and Calculation of Forecast Figures for The Maintenance on Escalators
Performance Analysis and Tuning for Machine Logs
I analyzed and tuned several performance issues to store and retrieve the data, bringing query runtimes back from minutes to milliseconds. I redeveloped the data pipeline so it would only store changes in machine constants (constants only change in less than 1% of the cases) instead of always storing all the machine constants and the complete machine log. I further designed and developed a point-in-time detection for the monitoring of non-conformances.
Digital Signage - Event and Sensor Data Processing and Data Visualization
I designed a solution using existing and proven open-source software, components, and frameworks, developed a data pipeline to store and process IoT beacon data, and used device detection for indoor positioning and proximity engagement. Furthermore, I used digital signage to deliver smart and interactive advertisements. For hot zone and cold zone detection, I developed heatmap visualizations so store flow could be visualized.
Multiple Dashboards, Analytical and Operational Reports
Skills
Languages
SQL, Python, Snowflake, R, Excel VBA
Tools
Oracle E-Business Suite (EBS), Apache Airflow, Apache Solr, Tableau, Microsoft Power BI, DataHub, AWS Glue, Looker
Paradigms
Requirements Analysis, Business Intelligence (BI), ETL, Scrum, Agile, Kanban, Data Science, Microservices
Storage
Oracle RDBMS, Oracle PL/SQL, Databases, PL/SQL, Netezza, PostgreSQL, Data Pipelines, MySQL, Data Lakes, Database Architecture, Database Migration, Data Integration, Elasticsearch, MongoDB, SQL Server Integration Services (SSIS), Amazon S3 (AWS S3), Master Data Management (MDM), NoSQL
Other
Data Engineering, Data Visualization, Business Process Analysis, Data Warehouse Design, Dashboard Design, Data Modeling, Performance Analysis, Oracle BI, Data, Data Warehousing, Analytics, Data Analysis, Data Architecture, Data Cleaning, Data Aggregation, Data Reporting, Data Analytics, Key Performance Indicators (KPIs), ELT, Warehouses, English, Query Optimization, Data Vaults, Business Process Modeling, Large Data Sets, Business Requirements, Data Management, Data Manipulation, Dashboards, Cloud, APIs, Data Structures, Advisory, Consulting, Data Processing, ETL Tools, Large-scale Projects, Technical Leadership, SWOT Analysis, Conceptual Design, Big Data, Big Data Architecture, Startups, Azure Data Factory, Delta Lake, Data Build Tool (dbt), Google Data Studio, CI/CD Pipelines, Azure Databricks, EMR Studio, Real-time Data
Platforms
Talend, Amazon Web Services (AWS), Docker, Linux, Oracle Data Integrator (ODI), Databricks, Azure, Kubernetes
Frameworks
Hadoop, Activiti BPM, Spark
Libraries/APIs
D3.js
Education
Bachelor of Science Degree in Information Technology
The Hague University of Applied Sciences - The Hague, The Netherlands
Certifications
Databricks Lakehouse Fundamentals
Databricks Academy
Containers and Microservices
IBM Big Data University
Applied Data Science with Python
IBM Big Data University
Spark, Hadoop Data Access and Big Data Analytics
IBM Big Data University
Professional Scrum Master (PSM I)
Scrum.org
Certified Business Intelligence Professional (CBIP)
TDWI.org
Oracle Business Intelligence (OBIEE)
Oracle
Oracle Designer for Conceptual Design
Oracle
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring