Brian is available for hire
Hire BrianBrian Weber
Verified Expert in Engineering
Data Architect and Developer
Dallas, TX, United States
Toptal member since May 23, 2024
Bio
Brian is a principal engineer with a solid architectural and development background in enterprise data management, services, and mobile development. With expertise in data and application security, Brian has worked with many Fortune 100 companies to achieve their technology objectives. Brian specializes in automating and verifying large-scale cloud application integration and cloud data migrations across varied data sources in high-availability scenarios and business continuity.
Portfolio
Tyler Watson
Data Engineering, Artificial Intelligence (AI), Data Science, Azure, OneDrive...
ReadyCap Commercial, LLC
PowerBuilder, Snowflake, Oracle, SQL, Microsoft, Data Management Platforms...
NCRI Services Inc.
Data Engineering, Back-end Development, Python, Java...
Experience
- Architecture - 20 years
- Oracle - 20 years
- Data Architecture - 20 years
- Distributed Systems - 20 years
- Networking - 20 years
- Enterprise Architecture - 20 years
- Security - 15 years
- Data Warehousing - 15 years
Preferred Environment
Oracle, Linux, Windows, MongoDB, Java, C#, JavaScript, SQL, Apache Lucene, Apache Kafka
The most amazing...
...thing I've developed is a high-availability sports-betting application with a corresponding statistic/analytics engine monetized through serverless APIs.
Work Experience
Data Engineer Consultant
2025 - 2025
Tyler Watson
- Architected an agentic RAG document intelligence platform on AWS using Lambda-based coordinated agents across ingestion and retrieval pipelines.
- Implemented a multi-index retrieval strategy (vector, keyword, summary, vision) with PostgreSQL and pgvector for high-confidence document search.
- Integrated AWS Textract and Amazon Bedrock to support complex document processing with flexible LLM model selection.
- Engineered primary parsing and indexing using MarkItDown and LlamaIndex across the ingestion pipeline.
- Designed a hybrid index retrieval with reranking to return results with citations and confidence statistics.
- Built API endpoints for ingestion and chat, enabling MCP server integration with frontends like ChatGPT.
- Delivered support for PDF, Word, Excel, PowerPoint, compressed files, and Google Workspace documents in a privacy-focused architecture.
Technologies: Data Engineering, Artificial Intelligence (AI), Data Science, Azure, OneDrive, Claude Code, Claude, RAG Architecture, RAG Systems, RAG Pipelines, Document Indexing, Document Parsing, Document Processing, AI Pipeline, Generative Artificial Intelligence (GenAI), Multimodal GenAI, Codex, ChatGPT, Model Context Protocol (MCP), AWS ECS Fargate, Amazon Elastic Container Registry (ECR), AWS Lambda, Amazon Bedrock, Gemini, OpenAI, Generative Artificial Intelligence (GenAI), Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), AI-assisted Development, Agentic Coding, Continuous Deployment, Continuous Integration (CI), Microsoft Copilot
PowerBuilder Expert
2024 - 2025
ReadyCap Commercial, LLC
- Architected and developed COBOL-to-Snowflake data decoding to eliminate Oracle dependency across 40,000+ data fields.
- Created Airflow plugins using Cobrix and Scala wrappers for direct COBOL datafile and copybook ETL processing.
- Designed a staged migration strategy enabling the reuse of existing scheduled jobs while data modernization proceeded.
- Integrated two PowerBuilder-based data products with a greenfield Snowflake modernization effort.
- Developed integration designs ensuring dependent peripheral systems and scheduled jobs remained operational during migration.
- Engineered ETL pipelines via Airflow to bypass legacy Oracle-based custom software in the COBOL data flow.
Technologies: PowerBuilder, Snowflake, Oracle, SQL, Microsoft, Data Management Platforms, Data Product Management, Data Management Platforms, Data Product Management, Database Migration, Data Enrichment, Data Mining, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), Continuous Deployment, Continuous Integration (CI), SQL Server
Data Engineer
2024 - 2024
NCRI Services Inc.
- Designed and developed an intelligence-gathering application for social networks to demonstrate the rate and degree of bias given the initial state and actions.
- Incorporated artificial intelligence via various LLMs and stealth automation technologies and tactics.
- Worked on an initial design that formed the basis of a patent application for a client.
Technologies: Data Engineering, Back-end Development, Python, Java, Machine Learning Operations (MLOps), Cybersecurity, Security, DevOps, Infrastructure as Code (IaC), Cloud Platforms, Project Management, Tools, Artificial Intelligence (AI), Scraping, Web Scraping, Google Sheets, Data Analysis, JSON, Full-stack, AI Agents, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, AI Integration, Generative Artificial Intelligence (GenAI), Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), AI-assisted Development, Agentic Coding, Generative Artificial Intelligence (GenAI), Continuous Deployment, Continuous Integration (CI), Microsoft Copilot
Principal Engineer
2023 - 2024
Citibank
- Served as a principal engineer for the Citi Shop program, which spanned two divisions at Citibank: rewards and branded cards.
- Handled Oracle data design and architecture, coordinating mobile and web development teams and activities.
- Assisted with performance issues using Splunk and Java virtual machine (JVM) troubleshooting methods.
- Coordinated with external vendors to ensure seamless and secure integration with internal systems. Sales data was ingested through JSON and integrated with internal API services.
- Designed and implemented a core data model and designed the data collection, ingestion, transport, and analytics protocols and methods to store the data in Oracle and provide transactional data to commissions and payments systems.
Technologies: Oracle, iOS, Android, Angular, Java, Spring Boot, Networking, Distributed Systems, Security, MongoDB, Legacy Code, Compliance, Regulations, Financials, Architecture, Enterprise Architecture, Database Design, Data Architecture, Data Warehousing, Legal, Data Engineering, Data Modeling, Databases, Oracle SOA Suite, Oracle PL/SQL, JSON, ETL, Python, Data, Data Flows, Git, Scalability, Static Analysis, Git Repo, Automation, CI/CD Pipelines, Data Integration, API Databases, Data Pipelines, Back-end Development, Cybersecurity, DevOps, NoSQL, Apache Maven, Data Analytics, Business Analysis, Data Extraction, Data Build Tool (dbt), Sigma.js, SQL, Microsoft, Data Governance, Data Stewardship, Data Lakehouse, Amazon S3 (AWS S3), Data Lake Design, Data Lakes, Elasticsearch, Swift, API Integration, REST APIs, Business Intelligence (BI), Algorithms, Database Administration (DBA), Jenkins, Data Science, ETL Implementation & Design, XML, Dimensional Modeling, Query Optimization, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Data Lineage, Medallion Architecture, Data Sourcing, Unix, Software Engineering, Analytical Thinking, Requirements Analysis, Performance, Database Optimization, SQL Performance, Deployment, ETL Tools, SQL Server 2019, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, Reliability Engineering, Amazon CloudWatch, IT Support, Database Performance, Data Reporting, Data Validation, Large-scale Data Migration, Cloud Platforms, Project Management, Tools, Database Partitioning, Personally Identifiable Information (PII), SQL, Data Analysis, JSON, Full-stack, Database Development, ETL Pipelines, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Data Management, Program Management, Product Management, Data Engineering, Data Management, Big Data, Product Requirements Documentation (PRD), Product Roadmaps, Data Management Platforms, Data Product Management, Data Orchestration, ELT, Database Migration, Data Enrichment, Data Mining, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), Continuous Deployment, Continuous Integration (CI), Apache Kafka, Pub/Sub, SQL Server, SharePoint
Lead Solutions Architect
2022 - 2022
ClubCorp/Invited Clubs
- Was responsible for building a team of developers to learn a 3rd-party acquired system and lift and shift the entire booking system and companion build systems to the acquiring company's hardware and software resources—in 30 days.
- Translated the entire infrastructure to versioned Terraform and established environments, landing zones, and automated promotion guidelines.
- Took responsibility for the overall solution and coordination of AWS infrastructure migration and supporting processes like CI/CD pipelines for the mobile applications and web front end.
Technologies: Amazon Web Services (AWS), Terraform, Containers, Spring Boot, iOS, Kotlin, Android, Java, Critical Security Controls (CIS Controls), Azure, MySQL, Data Engineering, Data Modeling, Databases, JSON, Python, GitHub Actions, DocumentDB, Data, Git, Scalability, Static Analysis, Git Repo, Automation, Azure Data Factory (ADF), CI/CD Pipelines, Data Integration, Docker, GitHub, Kubernetes, Back-end Development, Infrastructure as Code (IaC), DevOps, NoSQL, Apache Maven, CSV, Data Analytics, Business Analysis, SQL, Microsoft Power BI, Microsoft, Data Governance, Jetty, Amazon Elastic Container Registry (ECR), Amazon S3 (AWS S3), Amazon Elastic Container Service (ECS), Google Cloud Platform (GCP), Swift, API Integration, REST APIs, Node.js, Algorithms, Database Administration (DBA), Jenkins, Data Science, XML, MySQL DBA, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Consumer Applications, Data Sourcing, Unix, Software Engineering, Analytical Thinking, Requirements Analysis, Deployment, SQL Server 2019, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, Amazon CloudWatch, ECS, IT Support, Database Performance, Data Reporting, Data Validation, Go, Cloud Platforms, Project Management, Tools, Google Sheets, Azure DevOps, JSON, Full-stack, Amazon Simple Queue Service (SQS), Database Development, API Development, RESTFul APIs, Windows, Linux, JavaScript, Apache Lucene, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Google BigQuery, BigQuery, Program Management, Big Data, MacOS, MacBook, Database Migration, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), Continuous Deployment, Continuous Integration (CI), SQL Server
Principal Software Engineer
2021 - 2022
Stamps.com
- Implemented enterprise-wide centralized identity management system that aggregated internal user and warehouse inventory systems. This allowed for more efficient management of shipping activities and improved response to support tickets.
- Oversaw the overall architecture, database design, and identity implementation.
- Led a small team of subject matter experts and developers, as well as managed 3rd-party relationships related to the effort.
Technologies: Identity, Architecture, Enterprise Architecture, Identity & Access Management (IAM), Data Modeling, Databases, JSON, GitHub Actions, Data, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, Transact-SQL (T-SQL), Back-end Development, DevOps, NoSQL, SQL, Microsoft, Elasticsearch, TypeScript, API Integration, REST APIs, Node.js, Algorithms, Database Administration (DBA), Neo4j, Graph Databases, Jenkins, Data Science, XML, MySQL DBA, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Consumer Applications, Data Sourcing, Software Engineering, Analytical Thinking, Requirements Analysis, SQL Server 2019, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, IT Support, Database Performance, Data Reporting, Data Validation, Windows Forms (WinForms), Windows App Development, SQL Server DBA, Cloud Platforms, Project Management, Tools, Google Sheets, Active Directory (AD), Agile, Scrum, SQL, Data Analysis, JSON, Full-stack, Database Development, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), Continuous Deployment, Continuous Integration (CI), SQL Server
Consultant, Highly Specialized
2020 - 2020
United Healthcare
- Designed and developed a solution to allow US Health to monitor various social media pages and groups. The system had several regulatory and identity management requirements, as well as the need to interoperate scheduled processes.
- Designed and developed private APIs and servers with Azure Cloud assets and external resource APIs (such as Facebook Graph, Microsoft Azure AD, etc.). Privacy concerns mandate strict security, data privacy, transport, and federated user sign-in.
- Enabled administrators to generate and receive reports regarding current licensure and assignment of agents, flag questionable posts and comments for review using sentiment analysis, and perform automated removals and courses of action.
Technologies: Machine Learning, Social Networks, Social Networks Development, Social Network Analysis, Social Network Analytics, Informatica, Informatica Cloud, Informatica PowerCenter, Azure, Azure Data Factory (ADF), Azure SQL Databases, Microsoft Data Transformation Services (now SSIS), Transact-SQL (T-SQL), API Databases, Back-end Development, DevOps, NoSQL, CSV, Data Analytics, Business Analysis, Excel VBA, Data Extraction, SQL, Microsoft Power BI, PowerBuilder, Microsoft, Data Governance, Data Stewardship, API Integration, REST APIs, Algorithms, Database Administration (DBA), GraphDB, Neo4j, Graph Databases, Data Science, XML, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Consumer Applications, Data Sourcing, Unix, Software Engineering, Analytical Thinking, Requirements Analysis, Database Table Optimization, HIPAA Compliance, Web Design, Complex SQL Queries, Debugging, Database Performance, Data Reporting, Data Validation, Cloud Platforms, Project Management, Tools, Personally Identifiable Information (PII), Azure Active Directory, JSON, Full-stack, Database Development, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Google BigQuery, Data Management, BigQuery, Data Engineering, Data Management, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), SQL Server, SharePoint
Principal Consultant
2020 - 2020
Challenger Aerospace Systems
- Customized ERP systems using Odoo and secure migrations of features and data from competing and complementary systems.
- Was responsible for data security, audit, and reconciliation.
- Developed automated processes to migrate and checkpoint data movement.
Technologies: HubSpot, Data-level Security, Data Auditing, Data Migration, Enterprise Resource Planning (ERP), Data Engineering, Data Modeling, Databases, JSON, Data, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, HubSpot CRM, Back-end Development, DevOps, NoSQL, Business Analysis, Excel VBA, Data Extraction, SQL, PowerBuilder, Microsoft, API Integration, REST APIs, Algorithms, Database Administration (DBA), Data Science, XML, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Data Sourcing, Software Engineering, Analytical Thinking, Requirements Analysis, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, Database Performance, Data Reporting, Data Validation, Cloud Platforms, Project Management, Tools, JSON, Performance Tuning, Full-stack, Database Development, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA)
Principal Engineer | Software Architect
2019 - 2020
Broleans Media
- Designed and implemented a React and Serverless on Google Firebase client application, utilizing previously developed services.
- Focused on sports betting game/competition with a broadcast-ready, production-quality, filmed-for-television reality show.
- Built the final solution that covered all three major cloud providers: Google, AWS, and Azure.
Technologies: React, Cloud, Google Cloud, Azure, Amazon Web Services (AWS), Data Engineering, Data Modeling, Databases, Amazon Elastic MapReduce (EMR), Apache Airflow, JSON, Python, Digital Marketing, PySpark, ETL, AWS Lambda, Django, GitHub Actions, DocumentDB, Data, Data Flows, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, Docker, GitHub, Kubernetes, Apache Spark, Spark, Data Analysis, Snowflake, Startups, API Databases, Data Pipelines, Back-end Development, Amazon Kinesis, Cybersecurity, Infrastructure as Code (IaC), DevOps, NoSQL, Apache Maven, CSV, Data Analytics, Business Analysis, Excel VBA, Data Extraction, Sigma.js, SQL, Microsoft, Data Governance, Amazon Neptune, MapReduce, Hadoop, Jetty, PostgREST, Amazon Elastic Container Registry (ECR), Amazon S3 (AWS S3), Amazon Elastic Container Service (ECS), Google Cloud Platform (GCP), Data Lake Design, Data Lakes, Azure IaaS, AWS Glue, TypeScript, Swift, Vercel, API Integration, REST APIs, Business Intelligence (BI), Node.js, Amazon Aurora, Amazon Machine Learning, Algorithms, Database Administration (DBA), GraphDB, Neo4j, Graph Databases, AWS Serverless Application Model (SAM), AWS Step Functions, Jenkins, Data Science, ETL Implementation & Design, XML, Amazon RDS, SQL Server 2014, SQL Server 2017, MariaDB, Query Optimization, Database Architecture, Firebase, Cloud Firestore, Azure Databricks, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Data Lineage, Consumer Applications, Data Fetching, Data Sourcing, Unix, Cron, Software Engineering, Analytical Thinking, Requirements Analysis, Performance, Database Optimization, SQL Performance, Deployment, Python 3, SQL Server 2019, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, Reliability Engineering, Amazon CloudWatch, ECS, Database Performance, Data Reporting, Data Validation, Google Cloud Storage, Go, Cloud Key Management Service (KMS), Large-scale Data Migration, Electron, Cloud Platforms, Project Management, Tools, Database Partitioning, Excel Macros, Scraping, Web Scraping, Google Sheets, Azure Active Directory, Azure DevOps, SQL, Data Analysis, JSON, Performance Tuning, Sharding, Full-stack, Streaming, Amazon Simple Queue Service (SQS), Database Development, ETL Pipelines, Azure Logic Apps, API Development, RESTFul APIs, Windows, Linux, JavaScript, Apache Lucene, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Google Cloud Functions, Google BigQuery, Data Management, Relational Database Services (RDS), BigQuery, Program Management, Product Requirements Documentation (PRD), Product Roadmaps, MacOS, ELT, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), Database Replication, Read Replicas, Amazon Athena, Google Cloud Dataflow, Continuous Deployment, Continuous Integration (CI), Apache Flink, Apache Kafka, Pub/Sub
Principal Architect
2017 - 2018
Thomson Reuters
- Served as a principal architect and developer for NextGen DataFlow, the premier integration platform for the organization's Tax and Accounting Division.
- Took responsibility for server-side API design to ingest hundreds of thousands of Excel workbooks with up to hundreds of thousands of worksheets each and transform them into PostgreSQL JSON for analysis.
- Was responsible for the secure ingest and transfer of multinational tax data into a semi-structured format in PostgreSQL, which was then streamed to Big Four accounting firms.
Technologies: PostgreSQL, APIs, .NET, C#, AWS CloudFormation, Virtual Machines, Containers, Data Transformation, Data Engineering, Data Modeling, Databases, Microsoft Excel, JSON, ETL, Data, Data Flows, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, API Databases, Data Pipelines, Back-end Development, NoSQL, CSV, Data Analytics, Business Analysis, Excel VBA, Data Extraction, SQL, Microsoft, Data Governance, MapReduce, PostgREST, TypeScript, API Integration, REST APIs, Business Intelligence (BI), Algorithms, Database Administration (DBA), GraphDB, Neo4j, Graph Databases, Data Science, ETL Implementation & Design, XML, MySQL DBA, SQL Server 2014, SQL Server 2017, Query Optimization, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Data Lineage, Data Fetching, Data Sourcing, Unix, Cron, Software Engineering, Analytical Thinking, Requirements Analysis, Performance, Database Optimization, SQL Performance, ETL Tools, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, Reliability Engineering, Database Performance, Data Reporting, Data Validation, Large-scale Data Migration, Project Management, Tools, Database Partitioning, Excel Macros, Personally Identifiable Information (PII), Active Directory (AD), Agile, Scrum, SQL, Data Analysis, JSON, Performance Tuning, Sharding, Full-stack, Database Development, ETL Pipelines, Microsoft Office, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Data Management, Data Engineering, Data Management, Big Data, Data Management Platforms, Data Product Management, Data Orchestration, ELT, Database Migration, Data Enrichment, Data Mining, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), Continuous Deployment, Continuous Integration (CI), Apache Kafka, Pub/Sub, SQL Server
Principal Engineer, Data Mining and Machine Learning
2016 - 2017
Broleans Media
- Designed and developed statistical models and lambda for an online sports book and analytics platform that served as the back-end for an online sports betting application.
- Designed and developed the AWS lambdas for ingesting, aggregating, and processing historical game data and calculating game odds in real time.
- Oversaw the overall design and integration of user interface components, services layer API, and the data services, components, and stores.
Technologies: .NET, C#, API Design, Azure Cognitive Services, Ansible, Vagrant, Statistics, NuGet, NPM, Private NPM Modules, Python, Python API, AWS Lambda, AWS App Runner, Data Engineering, Cloud Applications, Data Integration, API Integration, Web Services, XML, Data Migration, Data Analysis, Startups, API Databases, Data Pipelines, Back-end Development, Amazon Kinesis, Cybersecurity, Infrastructure as Code (IaC), DevOps, Machine Learning Operations (MLOps), NoSQL, Apache Maven, CSV, Data Analytics, Business Analysis, Excel VBA, Data Extraction, SQL, Microsoft, Data Governance, Amazon Neptune, MapReduce, Hadoop, Jetty, PostgREST, Amazon Elastic Container Registry (ECR), Amazon S3 (AWS S3), Amazon Elastic Container Service (ECS), Google Cloud Platform (GCP), Data Lake Design, Data Lakes, Azure IaaS, AWS Glue, Pandas, TypeScript, Swift, REST APIs, Business Intelligence (BI), Node.js, Amazon Aurora, Amazon Machine Learning, PySpark, Algorithms, Database Administration (DBA), GraphDB, Neo4j, Graph Databases, AWS Serverless Application Model (SAM), AWS Step Functions, Jenkins, Data Science, ETL Implementation & Design, Amazon RDS, SQL Server 2014, SQL Server 2017, MariaDB, Query Optimization, Database Architecture, Firebase, Cloud Firestore, Azure Databricks, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Data Lineage, Consumer Applications, Data Fetching, Data Sourcing, Unix, Cron, Software Engineering, Analytical Thinking, Requirements Analysis, Performance, Database Optimization, SQL Performance, Deployment, Python 3, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, Reliability Engineering, Amazon CloudWatch, ECS, Database Performance, Data Reporting, Data Validation, Google Cloud Storage, Go, Cloud Key Management Service (KMS), Large-scale Data Migration, Electron, Cloud Platforms, Project Management, Tools, Database Partitioning, Excel Macros, Scraping, Web Scraping, Google Sheets, Azure Active Directory, Azure DevOps, SQL, Data Analysis, JSON, Performance Tuning, Sharding, Full-stack, Streaming, Amazon Simple Queue Service (SQS), Database Development, ETL Pipelines, Azure Logic Apps, API Development, RESTFul APIs, Windows, Linux, JavaScript, Apache Lucene, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Google Cloud Functions, Google BigQuery, Data Management, Relational Database Services (RDS), BigQuery, Program Management, Product Requirements Documentation (PRD), Product Roadmaps, MacOS, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), Database Replication, Read Replicas, Continuous Deployment, Continuous Integration (CI), Apache Flink, Apache Kafka, Pub/Sub
Software Architect
2016 - 2016
PWC
- Served as a director in the Global Tax Technology Division responsible for the infrastructure build-out and deployment activities for three new data centers worldwide on Azure assets.
- Was responsible for processing tax data feeds from Thomson Reuters and analyzing that data in support of optimizing tax strategies.
- Oversaw the data and perimeter security and testing procedures for PWC global data centers.
Technologies: Data Centers, Data Center Networks, Data Center Infrastructure, Global Strategy, Penetration Testing, Red Teaming, Firewalls, API Gateways, Azure, Microsoft SQL Server, Data Engineering, Data Modeling, Databases, Scala, JSON, Data, Data Flows, Git, Scalability, Static Analysis, Git Repo, Automation, Azure Data Factory (ADF), CI/CD Pipelines, Data Integration, Databricks, Transact-SQL (T-SQL), Data Pipelines, Back-end Development, NoSQL, Data Extraction, SQL, Tableau, Microsoft, Data Governance, MapReduce, Data Stewardship, Pandas, Service Broker, Service Broker Patterns, API Integration, REST APIs, Business Intelligence (BI), Algorithms, Database Administration (DBA), Data Science, ETL Implementation & Design, XML, SQL Server 2014, SQL Server 2017, Query Optimization, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Data Lineage, Data Fetching, Data Sourcing, Unix, Software Engineering, Analytical Thinking, Requirements Analysis, ETL Tools, Python 3, Database Table Optimization, HIPAA Compliance, Web Design, Complex SQL Queries, Debugging, Reliability Engineering, Amazon CloudWatch, Database Performance, Data Reporting, Data Validation, Large-scale Data Migration, SQL Server DBA, Project Management, Tools, Personally Identifiable Information (PII), Active Directory (AD), Agile, Scrum, SQL, Data Analysis, JSON, Performance Tuning, Database Development, ETL Pipelines, Microsoft Office, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Data Management, Program Management, Product Management, Data Engineering, Data Management, Big Data, Product Requirements Documentation (PRD), Product Roadmaps, Data Management Platforms, Data Product Management, Data Orchestration, Database Migration, Data Enrichment, Data Mining, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), Continuous Deployment, Continuous Integration (CI), SQL Server
Software Architect
2015 - 2015
Match.com
- Recommended the patterns and practices for developing a consistent, extensible REST API across all properties of The Match Group and established coding practices for the growing development team.
- Established guidelines for their mobile applications running on different form factors of iOS and Android and many user agents.
- Recommended and oversaw the implementation of Kafka distributing messaging to allow a 100x increase in the ability to handle traffic to user profiles and reliably identify user agents, leading to customized user experiences per device/form factor.
- Re-architectured user profile and the highest volume view to allow better, faster loading on low-bandwidth and occasionally connected devices. This also provided parity in the user experience across iOS and mobile clients.
Technologies: .NET, Android, iOS, PostgreSQL, Microsoft SQL Server, Apache Kafka, Data Modeling, Databases, Apache Airflow, JSON, Data, Data Flows, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, Transact-SQL (T-SQL), API Databases, Back-end Development, NoSQL, SQL, Microsoft, MapReduce, Elasticsearch, Service Broker, Service Broker Patterns, TypeScript, Swift, API Integration, REST APIs, Node.js, Algorithms, Database Administration (DBA), GraphDB, Neo4j, Graph Databases, Kafka Streams, Jenkins, Data Science, ETL Implementation & Design, XML, Query Optimization, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Consumer Applications, Data Fetching, Data Sourcing, Software Engineering, Analytical Thinking, Requirements Analysis, Performance, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, IT Support, Database Performance, Data Reporting, Data Validation, SQL Server DBA, Project Management, Tools, Database Partitioning, Personally Identifiable Information (PII), Active Directory (AD), Agile, Scrum, SQL, Data Analysis, JSON, Performance Tuning, Streaming, Database Development, API Development, RESTFul APIs, Windows, Linux, JavaScript, Apache Lucene, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), Continuous Deployment, Continuous Integration (CI), Pub/Sub, SQL Server
Principal Consultant
2012 - 2014
Connected Bits
- Architected and developed as part of a team, Spot Reporters and Spot Workers—a municipal and community issue reporting application. Launched in Boston and expanded to cities across the US and Canada.
- Designed and implemented the build and deployment processes.
- Produced automated data integrity and security checks.
Technologies: RubyMotion, Ruby on Rails 6, PostgreSQL, Data Modeling, Databases, JSON, Data, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, Informatica, Startups, Back-end Development, NoSQL, SQL, Microsoft, Hadoop, Swift, API Integration, REST APIs, Algorithms, Database Administration (DBA), Data Science, XML, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Consumer Applications, Data Fetching, Data Sourcing, Unix, Software Engineering, Analytical Thinking, Requirements Analysis, Ruby on Rails (RoR), Database Table Optimization, Web Design, Complex SQL Queries, Debugging, Amazon CloudWatch, Database Performance, Data Reporting, Data Validation, Go, Windows Forms (WinForms), Windows App Development, Project Management, Tools, JSON, Database Development, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, MacOS, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA)
Senior Development Manager
2009 - 2013
Deloitte (DTTL Deloitte Global)
- Led the performance team as part of a ground-up re-architecture and re-write of the Deloitte audit. This was a modernization effort on Microsoft technologies.
- Worked on data integrity and kernel performance issues. Designed and implemented load and stress tests used in the Microsoft Labs in North Carolina to isolate and fix garbage collection and memory pressure issues.
- Supported the global auditor workforce and the underlying client asset management through the resulting architecture.
Technologies: API/Services Architecture, Data Architecture, Data Engineering, Data Modeling, Databases, JSON, Data, Data Flows, Git, Scalability, Static Analysis, Git Repo, Automation, CI/CD Pipelines, Data Integration, Transact-SQL (T-SQL), SQL Server Integration Services (SSIS), Data Pipelines, Back-end Development, Cybersecurity, NoSQL, CSV, Data Analytics, Excel VBA, Data Extraction, SQL, Microsoft, Data Governance, MapReduce, Hadoop, Data Stewardship, API Integration, REST APIs, Algorithms, Database Administration (DBA), Data Science, XML, MySQL DBA, Query Optimization, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Data Fetching, Data Sourcing, Software Engineering, Analytical Thinking, Requirements Analysis, Performance, Database Optimization, SQL Performance, Deployment, Database Table Optimization, HIPAA Compliance, Web Design, Complex SQL Queries, Debugging, IT Support, Database Performance, Data Reporting, Data Validation, Large-scale Data Migration, SQL Server DBA, Project Management, Tools, Database Partitioning, Personally Identifiable Information (PII), Active Directory (AD), Azure Active Directory, Agile, Scrum, SQL, Data Analysis, JSON, Performance Tuning, Database Development, ETL Pipelines, Microsoft Office, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Data Management, Program Management, Data Engineering, Data Management, Big Data, Product Requirements Documentation (PRD), Product Roadmaps, Data Management Platforms, Data Product Management, Data Orchestration, Database Migration, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), Database Replication, Read Replicas, Continuous Deployment, Continuous Integration (CI), SQL Server
Senior Solution Architect
2002 - 2004
Avanade
- Architected and developed solutions for enterprise clients based upon Microsoft technologies as part of the consulting group in the Southwest.
- Designed and developed digital delivery and automated clearing house (ACH) systems.
- Focused on server performance improvement and kernel debugging.
Technologies: Java, .NET, C#, WCF Web Services, .NET WCF, Data Mapping, Relational Data Mapping, Startups, Transact-SQL (T-SQL), SQL Server Integration Services (SSIS), Data Pipelines, Back-end Development, Cybersecurity, CSV, Excel VBA, Data Extraction, SQL, PowerBuilder, Microsoft, Data Governance, Visual Basic for Applications (VBA), API Integration, REST APIs, Algorithms, Database Administration (DBA), Data Science, ETL Implementation & Design, XML, Jakarta Server Pages (JSP), MySQL DBA, Dimensional Modeling, Query Optimization, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Consumer Applications, Data Fetching, Data Sourcing, Microsoft Access, Unix, Cron, Software Engineering, Analytical Thinking, Requirements Analysis, Performance, Database Optimization, SQL Performance, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, Database Performance, Data Reporting, Data Validation, Windows Forms (WinForms), Windows App Development, SQL Server DBA, Project Management, Tools, Excel Macros, Personally Identifiable Information (PII), Active Directory (AD), SQL, Data Analysis, JSON, Performance Tuning, Amazon Simple Queue Service (SQS), Database Development, ETL Pipelines, Microsoft Office, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Data Management, Communication, Training, Program Management, Data Engineering, Data Management, Product Requirements Documentation (PRD), Product Roadmaps, Data Management Platforms, Database Migration, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), SQL Server
Manager, Software Development
1998 - 1999
Yahoo!
- Designed and developed APIs for Yahoo! Broadcast (formerly Broadcast.com) and automated call systems (IVR).
- Worked as liaison between Yahoo! (Sunnyvale, CA, USA) and Yahoo! Broadcast (Dallas, TX, USA) concerning integration efforts after the acquisition.
- Oversaw the development, reconciliation, and deprecation of services and data APIs.
Technologies: HTTP Live Streaming (HLS), REST APIs, Performance, Transact-SQL (T-SQL), Back-end Development, Excel VBA, Data Extraction, SQL, Microsoft, Data Governance, Visual Basic, API Integration, Algorithms, Database Administration (DBA), Data Science, XML, Jakarta Server Pages (JSP), MySQL DBA, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Consumer Applications, Data Fetching, Data Sourcing, Unix, Cron, Software Engineering, Analytical Thinking, Requirements Analysis, Database Optimization, SQL Performance, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, Database Performance, Data Reporting, Data Validation, Windows Forms (WinForms), SQL Server DBA, Project Management, Tools, SQL, Data Analysis, Performance Tuning, Database Development, API Development, RESTFul APIs, Windows, Linux, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Data Management, Program Management, Product Requirements Documentation (PRD), Product Roadmaps, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), SQL Server
Principal Consultant
1994 - 1998
Microsoft
- Worked as part of the initial team of consultants for Microsoft Consulting Services in the St. Louis office.
- Functioned as the distributed systems and operating system internals expert for the Midwest US.
- Assisted Microsoft's enterprise clients with their technology goals using Microsoft products. I was featured in Bill Gates' keynote for Windows CE as the lead engineer for GM/Saturn Vehicle Audit.
Technologies: C++, IIS, Microsoft SQL Server, Client Management, Client Delivery Management, Business Development, New Business Development, Windows CE, Game Design, COM, COM+, DCOM, Distributed Systems, Distributed Computing, Operating Systems, Kernel, Windows Kernel Debugging (WKD), Incident Response, Incident Management, Startups, Transact-SQL (T-SQL), SQL Server Integration Services (SSIS), Data Pipelines, Back-end Development, Cybersecurity, Excel VBA, Data Extraction, SQL, PowerBuilder, Microsoft, Data Governance, Visual Basic for Applications (VBA), Visual Basic, API Integration, Algorithms, Database Administration (DBA), Data Science, ETL Implementation & Design, XML, Jakarta Server Pages (JSP), MySQL DBA, Dimensional Modeling, Query Optimization, Database Architecture, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Consumer Applications, Data Fetching, Data Sourcing, Microsoft Access, Unix, Cron, Software Engineering, Analytical Thinking, Requirements Analysis, Performance, Database Optimization, SQL Performance, Database Table Optimization, Web Design, Complex SQL Queries, Debugging, Database Performance, Data Reporting, Data Validation, Windows Forms (WinForms), Windows App Development, SQL Server DBA, Project Management, Tools, Excel Macros, SQL, Data Analysis, Performance Tuning, Database Development, ETL Pipelines, Microsoft Office, API Development, Windows, JavaScript, Front-end, Team Leadership, Enterprise, Database Management, SQL Stored Procedures, DB, Data Management, Communication, Training, Program Management, Product Management, Product Requirements Documentation (PRD), Product Roadmaps, Database Migration, Transactions, Indexing, Logging, Locks, Root-cause Analysis (RCA), SQL Server
Experience
Citi Shop
https://www.citi.com/credit-cards/citishop/homeProvided technical oversight as the principal engineer on the project and coordinated data, mobile, and web architecture and development teams. I also architected the data security, transport, collection, processing, and reporting models.
Match.com
Match is an online dating service headquartered in Dallas, Texas. The company has offices in Dallas, West Hollywood, San Francisco, Tokyo, Rio de Janeiro, and Beijing. Match is owned by Match Group, which owns several other online dating services.
Thomson Reuters Dataflow
https://tax.thomsonreuters.com/en/onesource/workflow-manager/dataflowA .NET server-side product in the Tax Technology group that manages the ingest of multinational tax data and prepares it for streaming to PWC, Deloitte, EY, and KPMG. I was the principal architect for services and data on a ground-up effort to increase the capacity and efficiency of data import.
Spot Reporters and Spot Workers for Mobile
https://connectedbits.comThis is a white-labeled running on iOS and Android client as the basis for 12+ major cities in the US and Canada (ex. Dallas 311).
Connected Bits has been at the forefront of enterprise mobile technology for over 15 years. These are proven applications that have been used by millions of users worldwide.
From the team that brought you Street Bump, as featured in Wired.
Connected Bits has been at the forefront of enterprise mobile technology for over 15 years. These are proven applications that have been used by millions of users worldwide.
From the team that brought you Street Bump, as featured in Wired.
Education
1988 - 1992
Bachelor's Degree in Computer Engineering
Washington University in St. Louis - St. Louis, MO, USA
Skills
Libraries/APIs
Apache Lucene, React, PySpark, REST APIs, Node.js, Complex SQL Queries, Windows Forms (WinForms), API Development, PostgREST, Pandas, Cloud Key Management Service (KMS), Azure Cognitive Services, Python API, Sigma.js, OneDrive
Tools
AWS CloudFormation, Apache Airflow, Oracle SOA Suite, Microsoft Excel, Git, GitHub, Apache Maven, Jetty, Jenkins, Microsoft Access, Google Sheets, BigQuery, Logging, Terraform, Amazon Elastic MapReduce (EMR), Microsoft Power BI, Tableau, Amazon Elastic Container Registry (ECR), Amazon Elastic Container Service (ECS), AWS Glue, Kafka Streams, AWS Step Functions, Cron, Amazon Simple Queue Service (SQS), Azure Logic Apps, Claude Code, Claude, Codex, Ansible, Vagrant, NuGet, NPM, Informatica PowerCenter, Amazon CloudWatch, ChatGPT, Amazon Athena, Microsoft Copilot
Languages
Java, C#, JavaScript, SQL, Scala, Python, XML, Snowflake, Transact-SQL (T-SQL), Excel VBA, Visual Basic for Applications (VBA), Visual Basic, TypeScript, Swift, Ruby, Objective-C, Kotlin, PowerBuilder, Python 3, Go, C++
Frameworks
Angular, Spring Boot, .NET, Django, Apache Spark, Spark, AWS Serverless Application Model (SAM), RubyMotion, Ruby on Rails 6, Hadoop, Ruby on Rails (RoR), Electron, Data Lakehouse, Jakarta Server Pages (JSP)
Paradigms
Database Design, API Architecture, API/Services Architecture, Service-oriented Architecture (SOA), ETL, Automation, DevOps, Requirements Analysis, Windows App Development, Database Development, Continuous Deployment, Continuous Integration (CI), Penetration Testing, MapReduce, Business Intelligence (BI), ETL Implementation & Design, Dimensional Modeling, HIPAA Compliance, COM+, Distributed Computing, Model Context Protocol (MCP)
Platforms
Oracle, Linux, Windows, iOS, Android, Mobile, Azure, Amazon Web Services (AWS), AWS Lambda, Docker, Databricks, Microsoft, Google Cloud Platform (GCP), Azure IaaS, Firebase, Unix, Apache Kafka, Salesforce, HubSpot, Kubernetes, Vercel, MacOS, Apache Flink, SharePoint, Windows CE, Kernel
Storage
MongoDB, PostgreSQL, Microsoft SQL Server, Google Cloud, MySQL, Data Centers, Relational Databases, Databases, Oracle PL/SQL, JSON, Data Integration, Azure SQL Databases, SQL Server Integration Services (SSIS), API Databases, Data Pipelines, NoSQL, Amazon S3 (AWS S3), Data Lake Design, Elasticsearch, Service Broker, Amazon Aurora, Database Administration (DBA), SQL Server 2014, SQL Server 2017, Database Architecture, Cloud Firestore, SQL Performance, SQL Server 2019, Database Performance, Data Validation, SQL Server DBA, Database Management, SQL Stored Procedures, DB, Database Migration, Data Lakes, Neo4j, Graph Databases, MariaDB, Google Cloud Storage, Azure Active Directory, Database Replication
Industry Expertise
Web Design, Project Management, Cybersecurity
Other
Computer Engineering, Networking, Distributed Systems, Data Warehouse Design, Architecture, Data Architecture, Data Warehousing, Enterprise Architecture, Database Schema Design, Messaging, Cloud, Data-level Security, Data Auditing, Data Migration, APIs, Data Transformation, Data Center Networks, Data Center Infrastructure, Firewalls, API Gateways, Big Data, Streaming Data, Relational Database Design, Data Engineering, Data Modeling, GitHub Actions, DocumentDB, Data, Data Flows, Scalability, Git Repo, Azure Data Factory (ADF), CI/CD Pipelines, API Integration, Performance, Data Analysis, Startups, Microsoft Data Transformation Services (now SSIS), Back-end Development, Infrastructure as Code (IaC), CSV, Data Analytics, Business Analysis, Data Extraction, Data Governance, Service Broker Patterns, Algorithms, Data Science, MySQL DBA, Amazon RDS, Query Optimization, Azure Databricks, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Data Lineage, Medallion Architecture, Consumer Applications, Data Fetching, Data Sourcing, Software Engineering, Analytical Thinking, Database Optimization, ETL Tools, Database Table Optimization, Debugging, Data Reporting, Large-scale Data Migration, Cloud Platforms, Tools, Database Partitioning, Excel Macros, Personally Identifiable Information (PII), Active Directory (AD), Agile, Scrum, SQL, Data Analysis, JSON, Performance Tuning, Full-stack, ETL Pipelines, Microsoft Office, RESTFul APIs, Front-end, Team Leadership, Enterprise, Google Cloud Functions, Google BigQuery, Data Management, Relational Database Services (RDS), Communication, Training, Program Management, Data Engineering, Data Management, Product Requirements Documentation (PRD), Product Roadmaps, Data Management Platforms, Data Product Management, Data Orchestration, ELT, Transactions, Indexing, Locks, Root-cause Analysis (RCA), SQL Server, Security, Legacy Code, Compliance, Regulations, Legal, Financials, Identity & Access Management (IAM), SAP CRM, Dynamics CRM 365, Containers, Critical Security Controls (CIS Controls), Enterprise Resource Planning (ERP), Virtual Machines, Global Strategy, Red Teaming, Big Data Architecture, Digital Marketing, Static Analysis, Informatica, Machine Learning, Amazon Kinesis, Data Build Tool (dbt), Amazon Neptune, Data Stewardship, Amazon Machine Learning, GraphDB, Deployment, Reliability Engineering, IT Support, Artificial Intelligence (AI), Scraping, Web Scraping, Azure DevOps, Sharding, Streaming, AI Agents, AI Integration, Document Parsing, Generative Artificial Intelligence (GenAI), Gemini, OpenAI, Product Management, Big Data, Generative Artificial Intelligence (GenAI), MacBook, Data Enrichment, Data Mining, Read Replicas, AI-assisted Development, Agentic Coding, Google Cloud Dataflow, Pub/Sub, Identity, API Design, Statistics, Private NPM Modules, AWS App Runner, Cloud Applications, Web Services, IIS, Client Management, Client Delivery Management, Business Development, New Business Development, Game Design, COM, DCOM, Operating Systems, Windows Kernel Debugging (WKD), Incident Response, Incident Management, HTTP Live Streaming (HLS), WCF Web Services, .NET WCF, Data Mapping, Relational Data Mapping, HubSpot CRM, Social Networks, Social Networks Development, Social Network Analysis, Social Network Analytics, Informatica Cloud, Machine Learning Operations (MLOps), ECS, RAG Architecture, RAG Systems, RAG Pipelines, Document Indexing, Document Processing, AI Pipeline, Multimodal GenAI, AWS ECS Fargate, Amazon Bedrock, Data Management Platforms, Data Product Management
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring