Data Engineer
2021 - PRESENTWenzel Spine- Created and maintained ETL processes and ELT data pipelines from various sources.
- Utilized Python decorators, the data build tool (DBT) app, and APIs and deployed them to the Docker host and Kubernetes.
- Developed REST APIs and deployed them using Kubernetes.
Technologies: Docker, Kubernetes, Python, SQL Server DBA, Shell Scripting, REST APIs, SQL, ETL, Apache Airflow, Data Build Tool (dbt), Airbyte, MySQLDatabase Administrator
2020 - 2021Ercot- Upgraded and managed an extensive data warehouse database.
- Provided SQL tuning support to a developer during the upgrade process.
- Conducted a development and test database refresh and wrote a shell script to automate the refresh process.
- Performed periodic GI patching for over 200 databases during the patching cycle.
- Monitored databases and eliminated downtime by creating Linux and Unix shell and PL/SQL scripts.
- Planned and completed disaster recovery and switchover testing for databases.
- Used real application testing before critical database changes, including migration, upgrading, major patches, and deployment.
- Developed a database and system monitoring tool using PowerShell and Transact-SQL.
Technologies: Oracle, Linux, Shell Scripting, Upgrades, SQL Server DBAData Engineer
2018 - 2019Statera Spina- Built and orchestrated data pipelines using Apache Airflow.
- Introduced DBT to the ETL system to transform data and built DBT modules.
- Developed and maintained data pipelines that were ingesting data from various sources like Amazon S3 buckets, third-party REST APIs, SQL, and NoSQL databases.
Technologies: Apache Airflow, Data Build Tool (dbt), Data Pipelines, Amazon S3 (AWS S3), Docker, REST APIs, SQL, ETL, Amazon Web Services (AWS), Python, FivetranData Engineer
2017 - 2018Kredya- Utilized AWS Lambda, Amazon DynamoDB, Snowflake, Amazon RDS, Amazon S3, pandas, and Python.
- Built a DevOps pipeline on AWS using GitHub, Jenkins, Ansible, Docker, and Kubernetes.
- Designed and implemented data models for a data warehouse and data marts.
- Developed, maintained, and monitored ETL processes and ELT data pipelines.
- Provided SQL tuning support for the production database.
Technologies: Snowflake, Amazon Web Services (AWS), Amazon S3 (AWS S3), Pandas, Python, Jenkins, Git, Ansible, Docker, Kubernetes, AWS Lambda, SQL, PostgreSQL, Data Pipelines, ETL, ELTDatabase Administrator
2011 - 2017TEB- Supported and maintained over 200 Oracle databases in different environments, including production, test, development, and Oracle Active Data Guard.
- Implemented the migration of databases from Linux to Unix and vice versa.
- Cloned, refreshed, and restored Oracle databases for development and testing.
- Created multiple Linux and Unix shell and PL/SQL scripts to proactively monitor Oracle databases and eliminate downtime.
- Installed and configured integrated and classic GoldenGate for data replication.
- Configured, installed, and implemented PostgreSQL, SQL Server, and Cassandra databases.
- Set up PostgreSQL for high availability and replication with a hot standby.
- Planned and implemented Oracle and PostgreSQL backup strategies.
- Conducted various implementation tasks concerning alert monitoring for CPU usage, disk space, contention, and high events.
Technologies: Oracle, PostgreSQL, SQL Server DBA, Linux, Oracle GoldenGate, RMAN, ASM, Exadata, Shell Scripting, JiraData Engineer
2008 - 2011TEB- Wrote advanced queries, PL/SQL packages, functions, triggers, SQL scripts, and views.
- Developed ETL scripts to load data from multiple sources into the data warehouse and analyzed, cleaned, transformed, and loaded data using ODI.
- Utilized erwin for the warehouse's logical and physical database modeling.
Technologies: Python, PL/SQL, SQL, Oracle ODI, ETLSoftware Developer
2005 - 2008Obase- Created internal tools using Python, SQL, and Oracle.
- Analyzed, designed, and developed client applications using Oracle Forms and Report.
- Used Python to extract data from comma-separated values files, JSON, and Microsoft Excel.
Technologies: Python, APIs, Oracle