Staff Data Engineer
2021 - PRESENT
Dropbox
- Implemented a reliable integration with Google Ads Services.
- Migrated data pipelines from a legacy platform to Spark and Airflow.
- Consolidated legacy data platform elements into a strategic one.
Technologies: SQL, Python, Apache Airflow, Spark, Spark SQL, Apache Hive, Database Development, ETL, Database Design, Amazon S3 (AWS S3), Amazon EC2, Git, Databases, Data Modeling, Software Architecture, Shell Scripting, PySpark, Linux, Data Integration
Staff Data Engineer
2019 - 2021
Facebook
- Built an anomaly detection platform for a data platform authorization service.
- Implemented infrastructure analytics for real-time communication between Instagram and Messenger.
- Created a unified analytics platform for operational health monitoring for real-time communication products.
Technologies: SQL, Python, Apache Hive, Presto DB, Spark SQL, Spark, Database Development, ETL, Database Design, Databases, Data Modeling, Software Design, Shell Scripting, PySpark, Linux, Data Integration
Senior Back-end Engineer
2018 - 2019
Gradient
- Built a data platform to ingest and process data from different sources.
- Created data pipelines for Power BI analytics and ML algorithms.
- Constructed a monitoring and alerting tool to simplify data platform operations.
Technologies: Google Cloud, Apache Airflow, Python, Google BigQuery, Amazon Web Services (AWS), Database Development, ETL, Database Design, Amazon S3 (AWS S3), Amazon EC2, Git, Databases, Data Modeling, Software Design, Software Architecture, Shell Scripting, Linux, Data Integration
Lead Solution Architect of Data Platforms
2017 - 2018
Amazon Web Services
- Planned and implemented relational database migrations to AWS.
- Designed and implemented data warehouses, data lakes, and operational data stores in AWS.
- Designed and implemented data pipelines on AWS using SQL and Python.
- Created data models and database components for databases (Oracle) hosted on AWS RDS and EC2.
- Optimized the performance of reports and SQL queries for databases (Oracle) hosted in AWS.
- Created labs, sales demos, and conference activities for database migrations to AWS.
Technologies: Python, SQL, Amazon Web Services (AWS), Relational Databases, Database Development, ETL, Oracle RDBMS, Database Design, Amazon EC2, AWS CloudFormation, Amazon Aurora, Redshift, Pandas, Hadoop, Spark, Git, Databases, Data Modeling, Software Design, Software Architecture, Shell Scripting, PySpark, Linux, AWS EMR, Data Integration
Lead Data Architect
2005 - 2017
Deutsche Bank
- Consolidated legacy Oracle databases (up to 100TB in size) on an Exadata which included merging models and data, migrating data, and modifying PL/SQL, Shell, and Java code.
- Optimized the performance for reporting components on Exadata from hours-long running time to seconds.
- Created data model and database components (Oracle) for an application managing a lifecycle of listed derivatives transactions (2,000 transactions per second).
- Designed and implemented a data model and database code for a risk management platform to capture risk model parameters for every risk calculation for compliance reporting.
- Designed and implemented a dynamically configured reporting engine (in PL/SQL) for processing a 30TB dataset.
- Designed and implemented a data model and database code for a real-time warehouse for the sales IT department, receiving information from 150+ feeds, and applying complicated logic to calculate sales commissions.
Technologies: Shell Scripting, Databases, PL/SQL, Java, SQL, Exadata, Oracle, Python, Database Development, ETL, Oracle RDBMS, Database Design, Data Modeling, Software Design, Software Architecture, Linux, Data Integration
Senior Database Developer | Database Administrator
2000 - 2005
INIT-S
- Designed and developed document management systems and resource management systems for nuclear power plants to manage each power plant’s entire documentation process.
- Enhanced and automated resource management, performed database migration between different platforms (Sybase ASE, MS SQL Server, Oracle), database server administration, deployment packages creation, and consulting customers.
- Migrated critical databases from Sybase ASE to Oracle.
Technologies: SQL, Erwin, C#, Sybase, Microsoft SQL Server, Oracle, Database Development, ETL, Oracle RDBMS, Database Design, Databases, Data Modeling, Shell Scripting, Data Integration