Brian Weber
Verified Expert in Engineering
Data Architect and Developer
Dallas, TX, United States
Toptal member since May 23, 2024
Brian is a principal engineer with a solid architectural and development background in enterprise data management, services, and mobile development. With expertise in data and application security, Brian has worked with many Fortune 100 companies to achieve their technology objectives. Brian specializes in automating and verifying large-scale cloud application integration and cloud data migrations across varied data sources in high-availability scenarios and business continuity.
Portfolio
Experience
- Architecture - 20 years
- Oracle - 20 years
- Data Architecture - 20 years
- Distributed Systems - 20 years
- Networking - 20 years
- Enterprise Architecture - 20 years
- Security - 15 years
- Data Warehousing - 15 years
Availability
Preferred Environment
Oracle, Linux, Windows, MongoDB, Java, C#, JavaScript, SQL, Apache Lucene, Apache Kafka
The most amazing...
...thing I've developed is a high-availability sports-betting application with a corresponding statistic/analytics engine monetized through serverless APIs.
Work Experience
Data Engineer
NCRI Services Inc.
- Designed and developed an intelligence-gathering application for social networks to demonstrate the rate and degree of bias given the initial state and actions.
- Incorporated artificial intelligence via various LLMs and stealth automation technologies and tactics.
- Worked on an initial design that formed the basis of a patent application for a client.
Principal Engineer
Citibank
- Served as a principal engineer for the Citi Shop program, which spanned two divisions at Citibank: rewards and branded cards.
- Handled Oracle data design and architecture, coordinating mobile and web development teams and activities.
- Assisted with performance issues using Splunk and Java virtual machine (JVM) troubleshooting methods.
- Coordinated with external vendors to ensure seamless and secure integration with internal systems. Sales data was ingested through JSON and integrated with internal API services.
- Designed and implemented a core data model and designed the data collection, ingestion, transport, and analytics protocols and methods to store the data in Oracle and provide transactional data to commissions and payments systems.
Lead Solutions Architect
ClubCorp/Invited Clubs
- Was responsible for building a team of developers to learn a 3rd-party acquired system and lift and shift the entire booking system and companion build systems to the acquiring company's hardware and software resources—in 30 days.
- Translated the entire infrastructure to versioned Terraform and established environments, landing zones, and automated promotion guidelines.
- Took responsibility for the overall solution and coordination of AWS infrastructure migration and supporting processes like CI/CD pipelines for the mobile applications and web front end.
Principal Software Engineer
Stamps.com
- Implemented enterprise-wide centralized identity management system that aggregated internal user and warehouse inventory systems. This allowed for more efficient management of shipping activities and improved response to support tickets.
- Oversaw the overall architecture, database design, and identity implementation.
- Led a small team of subject matter experts and developers, as well as managed 3rd-party relationships related to the effort.
Consultant, Highly Specialized
United Healthcare
- Designed and developed a solution to allow US Health to monitor various social media pages and groups. The system had several regulatory and identity management requirements, as well as the need to interoperate scheduled processes.
- Designed and developed private APIs and servers with Azure Cloud assets and external resource APIs (such as Facebook Graph, Microsoft Azure AD, etc.). Privacy concerns mandate strict security, data privacy, transport, and federated user sign-in.
- Enabled administrators to generate and receive reports regarding current licensure and assignment of agents, flag questionable posts and comments for review using sentiment analysis, and perform automated removals and courses of action.
Principal Consultant
Challenger Aerospace Systems
- Customized ERP systems using Odoo and secure migrations of features and data from competing and complementary systems.
- Was responsible for data security, audit, and reconciliation.
- Developed automated processes to migrate and checkpoint data movement.
Principal Engineer | Software Architect
Broleans Media
- Designed and implemented a React and Serverless on Google Firebase client application, utilizing previously developed services.
- Focused on sports betting game/competition with a broadcast-ready, production-quality, filmed-for-television reality show.
- Built the final solution that covered all three major cloud providers: Google, AWS, and Azure.
Principal Architect
Thomson Reuters
- Served as a principal architect and developer for NextGen DataFlow, the premier integration platform for the organization's Tax and Accounting Division.
- Took responsibility for server-side API design to ingest hundreds of thousands of Excel workbooks with up to hundreds of thousands of worksheets each and transform them into PostgreSQL JSON for analysis.
- Was responsible for the secure ingest and transfer of multinational tax data into a semi-structured format in PostgreSQL, which was then streamed to Big Four accounting firms.
Principal Engineer, Data Mining and Machine Learning
Broleans Media
- Designed and developed statistical models and lambda for an online sports book and analytics platform that served as the back-end for an online sports betting application.
- Designed and developed the AWS lambdas for ingesting, aggregating, and processing historical game data and calculating game odds in real time.
- Oversaw the overall design and integration of user interface components, services layer API, and the data services, components, and stores.
Software Architect
PWC
- Served as a director in the Global Tax Technology Division responsible for the infrastructure build-out and deployment activities for three new data centers worldwide on Azure assets.
- Was responsible for processing tax data feeds from Thomson Reuters and analyzing that data in support of optimizing tax strategies.
- Oversaw the data and perimeter security and testing procedures for PWC global data centers.
Software Architect
Match.com
- Recommended the patterns and practices for developing a consistent, extensible REST API across all properties of The Match Group and established coding practices for the growing development team.
- Established guidelines for their mobile applications running on different form factors of iOS and Android and many user agents.
- Recommended and oversaw the implementation of Kafka distributing messaging to allow a 100x increase in the ability to handle traffic to user profiles and reliably identify user agents, leading to customized user experiences per device/form factor.
- Re-architectured user profile and the highest volume view to allow better, faster loading on low-bandwidth and occasionally connected devices. This also provided parity in the user experience across iOS and mobile clients.
Principal Consultant
Connected Bits
- Architected and developed as part of a team, Spot Reporters and Spot Workers—a municipal and community issue reporting application. Launched in Boston and expanded to cities across the US and Canada.
- Designed and implemented the build and deployment processes.
- Produced automated data integrity and security checks.
Senior Development Manager
Deloitte (DTTL Deloitte Global)
- Led the performance team as part of a ground-up re-architecture and re-write of the Deloitte audit. This was a modernization effort on Microsoft technologies.
- Worked on data integrity and kernel performance issues. Designed and implemented load and stress tests used in the Microsoft Labs in North Carolina to isolate and fix garbage collection and memory pressure issues.
- Supported the global auditor workforce and the underlying client asset management through the resulting architecture.
Senior Solution Architect
Avanade
- Architected and developed solutions for enterprise clients based upon Microsoft technologies as part of the consulting group in the Southwest.
- Designed and developed digital delivery and automated clearing house (ACH) systems.
- Focused on server performance improvement and kernel debugging.
Manager, Software Development
Yahoo!
- Designed and developed APIs for Yahoo! Broadcast (formerly Broadcast.com) and automated call systems (IVR).
- Worked as liaison between Yahoo! (Sunnyvale, CA, USA) and Yahoo! Broadcast (Dallas, TX, USA) concerning integration efforts after the acquisition.
- Oversaw the development, reconciliation, and deprecation of services and data APIs.
Principal Consultant
Microsoft
- Worked as part of the initial team of consultants for Microsoft Consulting Services in the St. Louis office.
- Functioned as the distributed systems and operating system internals expert for the Midwest US.
- Assisted Microsoft's enterprise clients with their technology goals using Microsoft products. I was featured in Bill Gates' keynote for Windows CE as the lead engineer for GM/Saturn Vehicle Audit.
Experience
Citi Shop
https://www.citi.com/credit-cards/citishop/homeMatch.com
https://www.match.comThomson Reuters Dataflow
https://tax.thomsonreuters.com/en/onesource/workflow-manager/dataflowSpot Reporters and Spot Workers for Mobile
https://connectedbits.comConnected Bits has been at the forefront of enterprise mobile technology for over 15 years. These are proven applications that have been used by millions of users worldwide.
From the team that brought you Street Bump, as featured in Wired.
Education
Bachelor's Degree in Computer Engineering
Washington University in St. Louis - St. Louis, MO, USA
Skills
Libraries/APIs
Apache Lucene, React, PySpark, REST APIs, Node.js, Complex SQL Queries, PostgREST, Pandas, Azure Cognitive Services, Python API, Sigma.js
Tools
AWS CloudFormation, Oracle SOA Suite, Microsoft Excel, Git, GitHub, Apache Maven, Jetty, Jenkins, Microsoft Access, Terraform, Amazon Elastic MapReduce (EMR), Apache Airflow, Microsoft Power BI, Tableau, Amazon Elastic Container Registry (ECR), Amazon Elastic Container Service (ECS), AWS Glue, Kafka Streams, AWS Step Functions, Cron, Ansible, Vagrant, NuGet, NPM, Informatica PowerCenter, Amazon CloudWatch
Languages
Java, C#, JavaScript, SQL, Scala, Python, XML, Snowflake, T-SQL (Transact-SQL), Excel VBA, Visual Basic for Applications (VBA), Visual Basic, TypeScript, Swift, Ruby, Objective-C, Kotlin, PowerBuilder, Python 3, Go, C++
Frameworks
Angular, Spring Boot, .NET, Django, Apache Spark, Spark, AWS Serverless Application Model (SAM), RubyMotion, Ruby on Rails 6, Hadoop, Ruby on Rails (RoR), Data Lakehouse, Jakarta Server Pages (JSP)
Paradigms
Database Design, API Architecture, API/Services Architecture, Service-oriented Architecture (SOA), ETL, Automation, DevOps, Requirements Analysis, Penetration Testing, MapReduce, Business Intelligence (BI), ETL Implementation & Design, Dimensional Modeling, HIPAA Compliance, COM+, Distributed Computing
Platforms
Oracle, Linux, Windows, Apache Kafka, iOS, Android, Mobile, Azure, Amazon Web Services (AWS), AWS Lambda, Docker, Databricks, Microsoft, Google Cloud Platform (GCP), Azure IaaS, Firebase, Unix, Salesforce, HubSpot, Kubernetes, Vercel, Windows CE, Kernel
Storage
MongoDB, PostgreSQL, Microsoft SQL Server, Google Cloud, MySQL, Data Centers, Relational Databases, Databases, Oracle PL/SQL, JSON, Data Integration, SQL Server Integration Services (SSIS), API Databases, Data Pipelines, NoSQL, Amazon S3 (AWS S3), Data Lake Design, Elasticsearch, Service Broker, Amazon Aurora, Database Administration (DBA), SQL Server 2014, SQL Server 2017, Database Architecture, Cloud Firestore, SQL Performance, SQL Server 2019, Database Performance, Data Validation, Data Lakes, Neo4j, Graph Databases, MariaDB, Google Cloud Storage, Azure SQL Databases
Industry Expertise
Web Design, Cybersecurity
Other
Computer Engineering, Networking, Distributed Systems, Data Warehouse Design, Architecture, Data Architecture, Data Warehousing, Enterprise Architecture, Database Schema Design, Messaging, Cloud, Data-level Security, Data Auditing, Data Migration, APIs, Data Transformation, Data Center Networks, Data Center Infrastructure, Firewalls, API Gateways, Big Data, Streaming Data, Relational Database Design, Data Engineering, Data Modeling, GitHub Actions, DocumentDB, Data, Data Flows, Scalability, Git Repo, Azure Data Factory, CI/CD Pipelines, API Integration, Performance, Data Analysis, Startups, Microsoft Data Transformation Services (now SSIS), Back-end Development, Infrastructure as Code (IaC), CSV, Data Analytics, Business Analysis, Data Extraction, Data Governance, Service Broker Patterns, Algorithms, Data Science, MySQL DBA, Amazon RDS, Query Optimization, Azure Databricks, Business Requirements, Stakeholder Management, Technical Leadership, Data Strategy, Data Lineage, Medallion Architecture, Consumer Applications, Data Fetching, Data Sourcing, Software Engineering, Analytical Thinking, Database Optimization, ETL Tools, Database Table Optimization, Debugging, Data Reporting, Large-scale Data Migration, Security, Legacy Code, Compliance, Regulations, Legal, Financials, Identity & Access Management (IAM), SAP CRM, Dynamics CRM 365, Containers, Critical Security Controls (CIS Controls), Enterprise Resource Planning (ERP), Virtual Machines, Global Strategy, Red Teaming, Big Data Architecture, Digital Marketing, Static Analysis, Informatica, Machine Learning, Amazon Kinesis, Data Build Tool (dbt), Amazon Neptune, Data Stewardship, Amazon Machine Learning, GraphDB, Deployment, Reliability Engineering, IT Support, Google Cloud Key Management Services (KMS), Identity, API Design, Statistics, Private NPM Modules, AWS App Runner, Cloud Applications, Web Services, IIS, Client Management, Client Delivery Management, Business Development, New Business Development, Game Design, COM, DCOM, Operating Systems, Windows Kernel Debugging (WKD), Incident Response, Incident Management, HTTP Live Streaming (HLS), WCF Web Services, .NET WCF, Data Mapping, Relational Data Mapping, HubSpot CRM, Social Networks, Social Networks Development, Social Network Analysis, Social Network Analytics, Informatica Cloud, Machine Learning Operations (MLOps), Neptune, ECS
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring