Brian Weber, Developer in Dallas, TX, United States
Brian is available for hire
Hire Brian

Brian Weber

Verified Expert  in Engineering

Data Architect and Developer

Location
Dallas, TX, United States
Toptal Member Since
May 23, 2024

Brian is a principal engineer with a solid architectural and development background in enterprise data management, services, and mobile development. With expertise in data and application security, Brian has worked with many Fortune 100 companies to achieve their technology objectives. Brian specializes in automating and verifying large-scale cloud application integration and cloud data migrations across varied data sources in high-availability scenarios and business continuity.

Portfolio

Citibank
Oracle, iOS, Android, Angular, Java, Spring Boot, Networking...
ClubCorp/Invited Clubs
Amazon Web Services (AWS), Terraform, Containers, Spring Boot, iOS, Kotlin...
Stamps.com
Identity, Architecture, Enterprise Architecture...

Experience

Availability

Part-time

Preferred Environment

Oracle, Linux, Windows, MongoDB, Java, C#, JavaScript, SQL, Apache Lucene, Apache Kafka

The most amazing...

...thing I've developed is a high-availability sports-betting application with a corresponding statistic/analytics engine monetized through serverless APIs.

Work Experience

Principal Engineer

2023 - 2024
Citibank
  • Served as a principal engineer for the Citi Shop program, which spanned two divisions at Citibank: rewards and branded cards.
  • Handled Oracle data design and architecture, coordinating mobile and web development teams and activities.
  • Assisted with performance issues using Splunk and Java virtual machine (JVM) troubleshooting methods.
  • Coordinated with external vendors to ensure seamless and secure integration with internal systems. Sales data was ingested through JSON and integrated with internal API services.
  • Designed and implemented a core data model and designed the data collection, ingestion, transport, and analytics protocols and methods to store the data in Oracle and provide transactional data to commissions and payments systems.
Technologies: Oracle, iOS, Android, Angular, Java, Spring Boot, Networking, Distributed Systems, Security, MongoDB, Legacy Code, Compliance, Regulations, Financials, Architecture, Enterprise Architecture, Database Design, Data Architecture, Data Warehousing, Legal, Data Engineering, Data Modeling, Databases, Oracle SOA Suite, Oracle PL/SQL, JSON, ETL, Python, Data, Data Flows, Git, Scalability, Static Analysis, Git Repo, Automation, CI/CD Pipelines, Data Integration, API Databases, Data Pipelines, Back-end Development, Cybersecurity, DevOps, NoSQL, Apache Maven, Data Analytics, Business Analysis, Data Extraction, Data Build Tool (dbt), Sigma.js, SQL, Microsoft, Data Governance, Data Stewardship, Data Lakehouse, Amazon S3 (AWS S3), Data Lake Design, Data Lakes, Elasticsearch, Swift, API Integration, REST APIs, Business Intelligence (BI), Algorithms

Lead Solutions Architect

2022 - 2022
ClubCorp/Invited Clubs
  • Was responsible for building a team of developers to learn a 3rd-party acquired system and lift and shift the entire booking system and companion build systems to the acquiring company's hardware and software resources—in 30 days.
  • Translated the entire infrastructure to versioned Terraform and established environments, landing zones, and automated promotion guidelines.
  • Took responsibility for the overall solution and coordination of AWS infrastructure migration and supporting processes like CI/CD pipelines for the mobile applications and web front end.
Technologies: Amazon Web Services (AWS), Terraform, Containers, Spring Boot, iOS, Kotlin, Android, Java, Critical Security Controls (CIS Controls), Azure, MySQL, Data Engineering, Data Modeling, Databases, JSON, Python, GitHub Actions, DocumentDB, Data, Git, Scalability, Static Analysis, Git Repo, Automation, Azure Data Factory, CI/CD Pipelines, Data Integration, Docker, GitHub, Kubernetes, Back-end Development, Infrastructure as Code (IaC), DevOps, NoSQL, Apache Maven, CSV, Data Analytics, Business Analysis, SQL, Microsoft Power BI, Microsoft, Data Governance, Jetty, Amazon Elastic Container Registry (ECR), Amazon S3 (AWS S3), Amazon Elastic Container Service (Amazon ECS), Google Cloud Platform (GCP), Swift, API Integration, REST APIs, Node.js, Algorithms

Principal Software Engineer

2021 - 2022
Stamps.com
  • Implemented enterprise-wide centralized identity management system that aggregated internal user and warehouse inventory systems. This allowed for more efficient management of shipping activities and improved response to support tickets.
  • Oversaw the overall architecture, database design, and identity implementation.
  • Led a small team of subject matter experts and developers, as well as managed 3rd-party relationships related to the effort.
Technologies: Identity, Architecture, Enterprise Architecture, Identity & Access Management (IAM), Data Modeling, Databases, JSON, GitHub Actions, Data, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, T-SQL (Transact-SQL), Back-end Development, DevOps, NoSQL, SQL, Microsoft, Elasticsearch, TypeScript, API Integration, REST APIs, Node.js, Algorithms

Consultant, Highly Specialized

2020 - 2020
United Healthcare
  • Designed and developed a solution to allow US Health to monitor various social media pages and groups. The system had several regulatory and identity management requirements, as well as the need to interoperate scheduled processes.
  • Designed and developed private APIs and servers with Azure Cloud assets and external resource APIs (such as Facebook Graph, Microsoft Azure AD, etc.). Privacy concerns mandate strict security, data privacy, transport, and federated user sign-in.
  • Enabled administrators to generate and receive reports regarding current licensure and assignment of agents, flag questionable posts and comments for review using sentiment analysis, and perform automated removals and courses of action.
Technologies: Machine Learning, Social Networks, Social Networks Development, Social Network Analysis, Social Network Analytics, Informatica, Informatica Cloud, Informatica PowerCenter, Azure, Azure Data Factory, Azure SQL Databases, Microsoft Data Transformation Services (now SSIS), T-SQL (Transact-SQL), API Databases, Back-end Development, DevOps, NoSQL, CSV, Data Analytics, Business Analysis, Excel VBA, Data Extraction, SQL, Microsoft Power BI, PowerBuilder, Microsoft, Data Governance, Data Stewardship, API Integration, REST APIs, Algorithms

Principal Consultant

2020 - 2020
Challenger Aerospace Systems
  • Customized ERP systems using Odoo and secure migrations of features and data from competing and complementary systems.
  • Was responsible for data security, audit, and reconciliation.
  • Developed automated processes to migrate and checkpoint data movement.
Technologies: HubSpot, Data-level Security, Data Auditing, Data Migration, Enterprise Resource Planning (ERP), Data Engineering, Data Modeling, Databases, JSON, Data, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, HubSpot CRM, Back-end Development, DevOps, NoSQL, Business Analysis, Excel VBA, Data Extraction, SQL, PowerBuilder, Microsoft, API Integration, REST APIs, Algorithms

Principal Engineer | Software Architect

2019 - 2020
Broleans Media
  • Designed and implemented a React and Serverless on Google Firebase client application, utilizing previously developed services.
  • Focused on sports betting game/competition with a broadcast-ready, production-quality, filmed-for-television reality show.
  • Built the final solution that covered all three major cloud providers: Google, AWS, and Azure.
Technologies: React, Cloud, Google Cloud, Azure, Amazon Web Services (AWS), Data Engineering, Data Modeling, Databases, Amazon Elastic MapReduce (EMR), Apache Airflow, JSON, Python, Digital Marketing, PySpark, ETL, AWS Lambda, Django, GitHub Actions, DocumentDB, Data, Data Flows, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, Docker, GitHub, Kubernetes, Apache Spark, Spark, Data Analysis, Snowflake, Startups, API Databases, Data Pipelines, Back-end Development, Amazon Kinesis, Cybersecurity, Infrastructure as Code (IaC), DevOps, NoSQL, Apache Maven, CSV, Data Analytics, Business Analysis, Excel VBA, Data Extraction, Sigma.js, SQL, Microsoft, Data Governance, Amazon Neptune, MapReduce, Hadoop, Jetty, PostgREST, Amazon Elastic Container Registry (ECR), Amazon S3 (AWS S3), Amazon Elastic Container Service (Amazon ECS), Google Cloud Platform (GCP), Data Lake Design, Data Lakes, Azure IaaS, AWS Glue, TypeScript, Swift, Vercel, API Integration, REST APIs, Business Intelligence (BI), Node.js, Amazon Aurora, Amazon Machine Learning, Neptune, Algorithms

Principal Architect

2017 - 2018
Thomson Reuters
  • Served as a principal architect and developer for NextGen DataFlow, the premier integration platform for the organization's Tax and Accounting Division.
  • Took responsibility for server-side API design to ingest hundreds of thousands of Excel workbooks with up to hundreds of thousands of worksheets each and transform them into PostgreSQL JSON for analysis.
  • Was responsible for the secure ingest and transfer of multinational tax data into a semi-structured format in PostgreSQL, which was then streamed to Big Four accounting firms.
Technologies: PostgreSQL, APIs, .NET, C#, AWS CloudFormation, Virtual Machines, Containers, Data Transformation, Data Engineering, Data Modeling, Databases, Microsoft Excel, JSON, ETL, Data, Data Flows, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, API Databases, Data Pipelines, Back-end Development, NoSQL, CSV, Data Analytics, Business Analysis, Excel VBA, Data Extraction, SQL, Microsoft, Data Governance, MapReduce, PostgREST, TypeScript, API Integration, REST APIs, Business Intelligence (BI), Algorithms

Principal Engineer, Data Mining and Machine Learning

2016 - 2017
Broleans Media
  • Designed and developed statistical models and lambda for an online sports book and analytics platform that served as the back-end for an online sports betting application.
  • Designed and developed the AWS lambdas for ingesting, aggregating, and processing historical game data and calculating game odds in real time.
  • Oversaw the overall design and integration of user interface components, services layer API, and the data services, components, and stores.
Technologies: .NET, C#, API Design, Azure Cognitive Services, Ansible, Vagrant, Statistics, NuGet, NPM, Private NPM Modules, Python, Python API, AWS Lambda, AWS App Runner, Data Engineering, Cloud Applications, Data Integration, API Integration, Web Services, XML, Data Migration, Data Analysis, Startups, API Databases, Data Pipelines, Back-end Development, Amazon Kinesis, Cybersecurity, Infrastructure as Code (IaC), DevOps, Machine Learning Operations (MLOps), NoSQL, Apache Maven, CSV, Data Analytics, Business Analysis, Excel VBA, Data Extraction, SQL, Microsoft, Data Governance, Amazon Neptune, MapReduce, Hadoop, Jetty, PostgREST, Amazon Elastic Container Registry (ECR), Amazon S3 (AWS S3), Amazon Elastic Container Service (Amazon ECS), Google Cloud Platform (GCP), Data Lake Design, Data Lakes, Azure IaaS, AWS Glue, Pandas, TypeScript, Swift, REST APIs, Business Intelligence (BI), Node.js, Amazon Aurora, Amazon Machine Learning, PySpark, Algorithms

Software Architect

2016 - 2016
PWC
  • Served as a director in the Global Tax Technology Division responsible for the infrastructure build-out and deployment activities for three new data centers worldwide on Azure assets.
  • Was responsible for processing tax data feeds from Thomson Reuters and analyzing that data in support of optimizing tax strategies.
  • Oversaw the data and perimeter security and testing procedures for PWC global data centers.
Technologies: Data Centers, Data Center Networks, Data Center Infrastructure, Global Strategy, Penetration Testing, Red Teaming, Firewalls, API Gateways, Azure, Microsoft SQL Server, Data Engineering, Data Modeling, Databases, Scala, JSON, Data, Data Flows, Git, Scalability, Static Analysis, Git Repo, Automation, Azure Data Factory, CI/CD Pipelines, Data Integration, Databricks, T-SQL (Transact-SQL), Data Pipelines, Back-end Development, NoSQL, Data Extraction, SQL, Tableau, Microsoft, Data Governance, MapReduce, Data Stewardship, Pandas, Service Broker, Service Broker Patterns, API Integration, REST APIs, Business Intelligence (BI), Algorithms

Software Architect

2015 - 2015
Match.com
  • Recommended the patterns and practices for developing a consistent, extensible REST API across all properties of The Match Group and established coding practices for the growing development team.
  • Established guidelines for their mobile applications running on different form factors of iOS and Android and many user agents.
  • Recommended and oversaw the implementation of Kafka distributing messaging to allow a 100x increase in the ability to handle traffic to user profiles and reliably identify user agents, leading to customized user experiences per device/form factor.
  • Re-architectured user profile and the highest volume view to allow better, faster loading on low-bandwidth and occasionally connected devices. This also provided parity in the user experience across iOS and mobile clients.
Technologies: .NET, Android, iOS, PostgreSQL, Microsoft SQL Server, Apache Kafka, Data Modeling, Databases, Apache Airflow, JSON, Data, Data Flows, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, T-SQL (Transact-SQL), API Databases, Back-end Development, NoSQL, SQL, Microsoft, MapReduce, Elasticsearch, Service Broker, Service Broker Patterns, TypeScript, Swift, API Integration, REST APIs, Node.js, Algorithms

Principal Consultant

2012 - 2014
Connected Bits
  • Architected and developed as part of a team, Spot Reporters and Spot Workers—a municipal and community issue reporting application. Launched in Boston and expanded to cities across the US and Canada.
  • Designed and implemented the build and deployment processes.
  • Produced automated data integrity and security checks.
Technologies: RubyMotion, Ruby on Rails 6, PostgreSQL, Data Modeling, Databases, JSON, Data, Git, Scalability, Git Repo, Automation, CI/CD Pipelines, Data Integration, Informatica, Startups, Back-end Development, NoSQL, SQL, Microsoft, Hadoop, Swift, API Integration, REST APIs, Algorithms

Senior Development Manager

2009 - 2013
Deloitte (DTTL Deloitte Global)
  • Led the performance team as part of a ground-up re-architecture and re-write of the Deloitte audit. This was a modernization effort on Microsoft technologies.
  • Worked on data integrity and kernel performance issues. Designed and implemented load and stress tests used in the Microsoft Labs in North Carolina to isolate and fix garbage collection and memory pressure issues.
  • Supported the global auditor workforce and the underlying client asset management through the resulting architecture.
Technologies: API/Services Architecture, Data Architecture, Data Engineering, Data Modeling, Databases, JSON, Data, Data Flows, Git, Scalability, Static Analysis, Git Repo, Automation, CI/CD Pipelines, Data Integration, T-SQL (Transact-SQL), SQL Server Integration Services (SSIS), Data Pipelines, Back-end Development, Cybersecurity, NoSQL, CSV, Data Analytics, Excel VBA, Data Extraction, SQL, Microsoft, Data Governance, MapReduce, Hadoop, Data Stewardship, API Integration, REST APIs, Algorithms

Senior Solution Architect

2002 - 2004
Avanade
  • Architected and developed solutions for enterprise clients based upon Microsoft technologies as part of the consulting group in the Southwest.
  • Designed and developed digital delivery and automated clearing house (ACH) systems.
  • Focused on server performance improvement and kernel debugging.
Technologies: Java, .NET, C#, WCF Web Services, .NET WCF, Data Mapping, Relational Data Mapping, Startups, T-SQL (Transact-SQL), SQL Server Integration Services (SSIS), Data Pipelines, Back-end Development, Cybersecurity, CSV, Excel VBA, Data Extraction, SQL, PowerBuilder, Microsoft, Data Governance, Visual Basic for Applications (VBA), API Integration, REST APIs, Algorithms

Manager, Software Development

1998 - 1999
Yahoo!
  • Designed and developed APIs for Yahoo! Broadcast (formerly Broadcast.com) and automated call systems (IVR).
  • Worked as liaison between Yahoo! (Sunnyvale, CA, USA) and Yahoo! Broadcast (Dallas, TX, USA) concerning integration efforts after the acquisition.
  • Oversaw the development, reconciliation, and deprecation of services and data APIs.
Technologies: HTTP Live Streaming (HLS), REST APIs, Performance, T-SQL (Transact-SQL), Back-end Development, Excel VBA, Data Extraction, SQL, Microsoft, Data Governance, Visual Basic, API Integration, Algorithms

Principal Consultant

1994 - 1998
Microsoft
  • Worked as part of the initial team of consultants for Microsoft Consulting Services in the St. Louis office.
  • Functioned as the distributed systems and operating system internals expert for the Midwest US.
  • Assisted Microsoft's enterprise clients with their technology goals using Microsoft products. I was featured in Bill Gates' keynote for Windows CE as the lead engineer for GM/Saturn Vehicle Audit.
Technologies: C++, IIS, Microsoft SQL Server, Client Management, Client Delivery Management, Business Development, New Business Development, Windows CE, Game Design, COM, COM+, DCOM, Distributed Systems, Distributed Computing, Operating Systems, Kernel, Windows Kernel Debugging (WKD), Incident Response, Incident Management, Startups, T-SQL (Transact-SQL), SQL Server Integration Services (SSIS), Data Pipelines, Back-end Development, Cybersecurity, Excel VBA, Data Extraction, SQL, PowerBuilder, Microsoft, Data Governance, Visual Basic for Applications (VBA), Visual Basic, API Integration, Algorithms

Citi Shop

https://www.citi.com/credit-cards/citishop/home
Provided technical oversight as the principal engineer on the project and coordinated data, mobile, and web architecture and development teams. I also architected the data security, transport, collection, processing, and reporting models.

Match.com

https://www.match.com
Match is an online dating service headquartered in Dallas, Texas. The company has offices in Dallas, West Hollywood, San Francisco, Tokyo, Rio de Janeiro, and Beijing. Match is owned by Match Group, which owns several other online dating services.

Thomson Reuters Dataflow

https://tax.thomsonreuters.com/en/onesource/workflow-manager/dataflow
A .NET server-side product in the Tax Technology group that manages the ingest of multinational tax data and prepares it for streaming to PWC, Deloitte, EY, and KPMG. I was the principal architect for services and data on a ground-up effort to increase the capacity and efficiency of data import.

Spot Reporters and Spot Workers for Mobile

https://connectedbits.com
This is a white-labeled running on iOS and Android client as the basis for 12+ major cities in the US and Canada (ex. Dallas 311).

Connected Bits has been at the forefront of enterprise mobile technology for over 15 years. These are proven applications that have been used by millions of users worldwide.

From the team that brought you Street Bump, as featured in Wired.
1988 - 1992

Bachelor's Degree in Computer Engineering

Washington University in St. Louis - St. Louis, MO, USA

Libraries/APIs

Apache Lucene, React, PySpark, REST APIs, Node.js, PostgREST, Pandas, Azure Cognitive Services, Python API, Sigma.js

Tools

AWS CloudFormation, Oracle SOA Suite, Microsoft Excel, Git, GitHub, Apache Maven, Jetty, Terraform, Amazon Elastic MapReduce (EMR), Apache Airflow, Microsoft Power BI, Amazon Elastic Container Registry (ECR), Amazon Elastic Container Service (Amazon ECS), AWS Glue, Ansible, Vagrant, NuGet, NPM, Informatica PowerCenter, Tableau

Frameworks

Angular, Spring Boot, .NET, Django, Apache Spark, Spark, RubyMotion, Ruby on Rails 6, Hadoop, Data Lakehouse

Languages

Java, C#, JavaScript, SQL, Scala, Python, Snowflake, T-SQL (Transact-SQL), Excel VBA, Visual Basic for Applications (VBA), Visual Basic, TypeScript, Swift, Ruby, Objective-C, Kotlin, PowerBuilder, XML, C++

Paradigms

Database Design, API Architecture, API/Services Architecture, Service-oriented Architecture (SOA), ETL, Automation, DevOps, Penetration Testing, MapReduce, Business Intelligence (BI), COM+, Distributed Computing

Platforms

Oracle, Linux, Windows, Apache Kafka, iOS, Android, Mobile, Azure, Amazon Web Services (AWS), AWS Lambda, Docker, Databricks, Microsoft, Google Cloud Platform (GCP), Azure IaaS, Salesforce, HubSpot, Kubernetes, Vercel, Windows CE, Kernel

Storage

MongoDB, PostgreSQL, Microsoft SQL Server, Google Cloud, MySQL, Data Centers, Relational Databases, Databases, Oracle PL/SQL, JSON, Data Integration, SQL Server Integration Services (SSIS), API Databases, Data Pipelines, NoSQL, Amazon S3 (AWS S3), Data Lake Design, Elasticsearch, Service Broker, Amazon Aurora, Data Lakes, Azure SQL Databases

Industry Expertise

Cybersecurity

Other

Computer Engineering, Networking, Distributed Systems, Data Warehouse Design, Architecture, Data Architecture, Data Warehousing, Enterprise Architecture, Database Schema Design, Messaging, Cloud, Data-level Security, Data Auditing, Data Migration, APIs, Data Transformation, Data Center Networks, Data Center Infrastructure, Firewalls, API Gateways, Big Data, Streaming Data, Relational Database Design, Data Engineering, Data Modeling, GitHub Actions, DocumentDB, Data, Data Flows, Scalability, Git Repo, Azure Data Factory, CI/CD Pipelines, API Integration, Data Analysis, Startups, Microsoft Data Transformation Services (now SSIS), Back-end Development, Infrastructure as Code (IaC), CSV, Data Analytics, Business Analysis, Data Extraction, Data Governance, Service Broker Patterns, Algorithms, Security, Legacy Code, Compliance, Regulations, Legal, Financials, Identity & Access Management (IAM), SAP CRM, Dynamics CRM 365, Containers, Critical Security Controls (CIS Controls), Enterprise Resource Planning (ERP), Virtual Machines, Global Strategy, Red Teaming, Big Data Architecture, Digital Marketing, Static Analysis, Informatica, Machine Learning, Amazon Kinesis, Data Build Tool (dbt), Amazon Neptune, Data Stewardship, Amazon Machine Learning, Identity, API Design, Statistics, Private NPM Modules, AWS App Runner, Cloud Applications, Web Services, IIS, Client Management, Client Delivery Management, Business Development, New Business Development, Game Design, COM, DCOM, Operating Systems, Windows Kernel Debugging (WKD), Incident Response, Incident Management, HTTP Live Streaming (HLS), Performance, WCF Web Services, .NET WCF, Data Mapping, Relational Data Mapping, HubSpot CRM, Social Networks, Social Networks Development, Social Network Analysis, Social Network Analytics, Informatica Cloud, Machine Learning Operations (MLOps), Neptune

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring