Data | Java Architect2021 - PRESENTYara
- Designed migration path for more than 100,000 users web application from monolith to microservices.
- Led a team of four developers to implement the designed application migration path.
- Took ownership of all PostgreSQL changes related to the migration.
- Designed database table structure to allow for Outbox pattern implementation to stream data to Apache Kafka.
Technical Writer2017 - PRESENTIOD (via Toptal)
Technologies: Amazon Web Services (AWS), Database Management Systems (DBMS), Azure, AWS, NetApp
- Wrote technical articles, whitepapers and blog posts for NetApp relating to their latest cloud offerings, including ONTAP Cloud and Cloud Sync.
- Worked with stakeholders to create ideas for new articles, determine article scope and review changes.
- Performed proof-of-concept and performance testing work in AWS with ONTAP Cloud in order to provide statistics and test results for various articles.
- Ensured the technical accuracy of articles produced by other writers.
Database Architect | Java Lead | AWS Architect2018 - 2021Open Practice Solutions
Technologies: Amazon Web Services (AWS), Docker, Elasticsearch, Grafana, Graphite, AWS, Galera Cluster, MariaDB, WebFlux, Spring 5, Boot, Spring, Java, MySQL, MonetDB, OLAP
- Designed a database, optimized queries, indexed, and performed administration work for MySQL.
- Designed and deployed a new MySQL database environment to an AWS-based Galera cluster with ZFS storage.
- Led the design and development of new micro-services environment using Java and Spring WebFlux, and implemented services for payments and notifications.
- Containerized all application deployments and migrated to Docker.
- Built the AWS cloud environment from scratch, including site-to-site VPN, cross-site DNS, AWS Auto Scaling, database deployment, Redis caching, and more.
- Designed and implemented a monitoring platform for all AWS and private cloud servers and applications using Graphite, ElasticSearch, logstash, Telegraf, and Grafana.
- Built an event-driven streaming data pipeline solution using Java, MySQL, Debezium, and Apache Kafka.
- Designed and implemented an OLAP data analytics platform using MonetDB columnar database and the Pentaho Mondrian OLAP server.
Database Architect | Node.js Developer2018 - 2019Perdoor (via Toptal)
- Designed and implemented a back-end RESTful API for mobile property app, including a database design and development using MySQL.
- Worked with project owner to aid in product development and design of the iOS mobile app UI.
- Deployed all back-end services to AWS and the setup of cloud-based dev/test environments.
AWS RDS | Database Developer2018 - 2018Quick, Inc. (via Toptal)
- Designed new, relational database schema in PostgreSQL for migration to AWS RDS from existing Firebase system.
- Created the full documentation, including database diagrams, design overview, additional functionality, such as for encryption-at-rest & field-level encryption, etc.
Database Designer | Node.js Developer2017 - 2018Humanlytics (via Toptal)
- Completely redesigned an MS SQL database system created by Chinese developers which required working with the team in China through translated Skype sessions to understand the requirements.
- Wrote migration scripts to populate the new database schema from the existing data as well as performing a reconciliation to ensure migrated data was accurate.
- Developed a RESTful API from scratch using Node.js (ESLint, Flow, Jest, Sequelize) and based on the newly developed database system.
- Created API endpoints for reporting that enabled users to specify custom data warehousing style aggregate queries to return data for the dashboards and reports.
- Implemented Apache Solr to provide search capability for customers, personnel, departments, and more. Developed independent business logic modules for salary calculation with full unit test coverage.
- Managed the set up and deployment of the API and front-end UI in AWS and Ali Cloud using Docker. Created a daily database refresh mechanism for the new database system hosted in Ali Cloud RDS.
Data Engineer | BI Developer2017 - 2017Cartful Solutions, Inc. (via Toptal)
Technologies: JSON, SQL, Redshift, Relational Database Services (RDS), PostgreSQL
- Developed complex reporting functions in SQL for event data stored in Amazon RDS for PostgreSQL.
- Made significant use of PostgreSQL JSON support to query event payloads.
- Designed a reporting schema for the data to be hosted on Amazon RedShift.
- Developed an ETL process for the event data to be loaded into the reporting schema.
CTO2015 - 2016Vedel IT Sdn Bhd
Technologies: AngularJS, REST, PostgreSQL, Java
- Developed a back-end REST API for an in-house recruitment system using Java and PostgreSQL.
- Took ownership of the technical evaluation for new hires in various technology areas.
- Provided presales technical consultations for prospective clients.
- Performed structured evaluations of competing third-party software platforms for the company's back-office processes.
- Implemented the line management for the company's internal IT team.
SQL Server BI Architect2015 - 2015Cubic Transportation Systems Ltd.
Technologies: Oracle, AngularJS, Model View Controller (MVC), SOAP, ASP.NET, SSRS, SSAS, SQL Server Integration Services (SSIS), Microsoft SQL Server
- Designed and implemented a project that involved an accounting and operations data warehouse using SQL Server 2014 Analysis Services.
- Developed a web application to manage invoicing information using ASP.NET MVC and AngularJS.
- Built a back-end SOAP web service in C# to support the invoicing application's front-end.
- Implemented an SSIS ETL process to pull data from multiple data sources, including Oracle.
- Performed on-call support for the TfL's (Transport for London) SQL Server infrastructure.
MySQL Database Administrator and Developer2013 - 2015City Link, Ltd.
Technologies: SSAS, Microsoft SQL Server, D3.js, WebSockets, Memcached, RabbitMQ, Java, MySQL
- Migrated and upgraded MySQL servers from a physical to a virtual cloud—including a configuration review, performance testing of new servers, and setup of replication for high availability.
- Developed a message processing back-end system using Java, RabbitMQ, and Memcached for the processing of over a million real-time messages per day.
- Built a WebSockets-based web front-end dashboards for real-time reporting using D3.js.
- Assessed various NoSQL solutions, including Redis and Riak, to be used alongside MySQL.
- Designed and implemented a financial data warehouse using SQL Server Analysis Services.
Database Architect2006 - 2013Aspect Capital, Ltd.
Technologies: Windows PowerShell, Zenoss, Vertica, NetApp, C++/CLI, C, C++, Java, Oracle, Microsoft SQL Server
- Rearchitected the legacy environment from multiple platforms, including Oracle and MySQL, to a single MS SQL environment with a clear separation of OLTP and reporting.
- Implemented a system on top of the NetApp SAN infrastructure to provide a snapshot-based backup/restore and the instant creation of writable clone copies for databases of any size for testing.
- Set up a database mirroring for high availability as well as implementing PowerShell scripts to perform failovers.
- Developed a transformative transactional replication system using C++/CLI and MS SQL features, such as CDC and Service Broker, to implement a real-time reporting system.
- Performed a POC for three different competing platforms to host a financial tick database holding row volumes in the billions, including Oracle HCC (Hybrid Columnar Compression) and Vertica.
- Implemented a PowerShell-based SQL Server build system for performing repeatable server builds—allowing for full operating system and database server configuration.
- Implemented a Windows service using C++/CLI to manage the MS SQL database environment—including backups, maintenance, archiving, monitoring, and documentation.
MS SQL DBA and Developer2003 - 2006Newchurch Ltd.
Technologies: Clustering, Linux, DTS, .NET, Java, PL/SQL, Oracle, Microsoft SQL Server
- Administered to an MS SQL server for a two-node failover cluster environment hosting externally-accessed reporting back-end.
- Maintained Oracle development servers as well as providing support and advice to .NET and database developers.
- Designed and implemented a large-scale Oracle batch processing system using PL/SQL and Java.
- Implemented a data transformation system for hospital episode statistics using Oracle and featuring complex multi-row calculations.
Developer2000 - 2003The Retail Experience, Ltd.
Technologies: Microsoft SQL Server, Visual Basic
- Developed a handheld-based productivity system for a major footwear retailer.
- Built a PoC for using MS SQL replication for managing the distribution of data to 300 remote sites.
- Implemented a complex reporting SQL for the company's back-end MIS reporting system.
- Implemented the commission part of the system—including application development and back-end SQL reporting.