Mikio Oba
Verified Expert in Engineering
Data Engineer and Software Developer
Mikio is an independent data engineer who loves solving clients' problems using his analytical and problem-solving skills based on the rational approach and 20+ years of industry experience. He is a lifelong learner who continuously pursues knowledge for personal and professional reasons. Mikio combines his passion for learning new technologies with his software engineering skills to continue helping clients.
Portfolio
Experience
Availability
Preferred Environment
Linux, Python, SQL, Amazon Web Services (AWS), Python 3
The most amazing...
...feedback I've received from my coworkers is that my work was impeccable as always.
Work Experience
Data Engineer
PepsiCo Global - Main
- Architected comprehensive refactoring of several complex data ingestion pipelines by leveraging Airflow, dbt, and Snowflake technologies, successfully enhancing efficiency and maintainability to ensure a more robust and scalable data infrastructure.
- Engaged in cross-functional collaboration with a team of data scientists to develop and deploy data pipelines tailored explicitly for a new market segment, enhancing the data-driven decision-making framework for strategic market positioning.
- Initiated and executed the integration of enhanced data observability features within the Airflow data pipelines by utilizing the Monte Carlo technologies, improving the reliability and accuracy of the data processing operations.
Python Software Engineer
UBS
- Developed and maintained Apache Spark and Python (PySpark) applications that process Avro messages between operational and analytical systems used by data scientists.
- Built single-handedly an integration test framework in Python for Spark applications.
- Managed the quality assurance process according to the company's software development lifecycle as a test manager.
- Solved various production incidents based on analytical and rational approaches.
- Created and shared technical tutorials on the basics and advanced usage of Pytest.
SQL Data Warehouse Developer
UBS
- Developed SQL-based ETL applications for compliance, security, and marketing purposes in the company’s petabyte-sized data warehouse.
- Contributed to the project to build a shareholder reporting system as a primary software developer.
- Solved various production incidents based on analytical and rational approaches.
Data Warehouse Engineer
John Lewis Partnership
- Built a company’s extensive customer data warehouse system from scratch.
- Optimized various analytical queries and batch jobs to reduce the execution time by an order of magnitude.
- Provided technical support to users and developers regarding Db2 issues.
- Developed a few dozen SQL procedures for ETL applications and database administration.
- Implemented disaster recovery plans for the data warehouse system.
Education
Master's Degree in Information Systems
The University of Sheffield - Sheffield, United Kingdom
Master's Degree in Aeronautics and Astronautics
The University of Tokyo - Tokyo, Japan
Bachelor's Degree in Aeronautics and Astronautics
The University of Tokyo - Tokyo, Japan
Certifications
SnowPro Core Certification
Snowflake
Certified Terraform Associate
HashiCorp
AWS Certified Developer – Associate
Amazon Web Services
AWS Certified Solutions Architect – Associate
Amazon Web Services Training and Certification
Data Structures and Algorithms Nanodegree
Udacity
Skills
Libraries/APIs
PySpark, Pandas, REST APIs
Tools
Apache Airflow, Terraform, Git, Ansible, Jira, GitLab CI/CD, Pytest, Amazon Athena, AWS Glue, AWS Step Functions, GitHub
Storage
SQL Stored Procedures, Relational Databases, Databases, PostgreSQL, Data Pipelines, MySQL, Amazon S3 (AWS S3)
Languages
SQL, Python, Snowflake, JavaScript, Python 3
Frameworks
Spark, Hadoop
Platforms
Linux, Apache Kafka, Amazon Web Services (AWS), AWS Lambda
Paradigms
Agile Software Development, Continuous Delivery (CD), DevOps, ITIL, ETL, Unit Testing, Agile, UX Design
Other
Data Warehousing, Data Engineering, ETL Development, Data Build Tool (dbt), Management Information Systems (MIS), Programming Languages, Shell Scripting, Big Data, Machine Learning, Data Structures, Algorithms, Exploratory Data Analysis, Data Analysis, AWS Cloud Architecture, AWS DevOps, DevOps Engineer, Cloud, Infrastructure as Code (IaC), Data Cleansing, Data Virtualization, System Testing, Amazon RDS, Technical Writing, Tutorials, Translation, Website Translation, Monte Carlo, ELT
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring