Gabriel Tavares de Souza

Led the end-to-end design and delivery of HINDSITE's complete product platform, a work management and remote expert assistance solution for industrial and mining operations, serving Rio Tinto, Anglo American, and Glencore. Owned the full product lifecycle from initial architecture through every layer of the system up to the company's successful market launch.

Delivered a sophisticated system combining digital workflows, live video communication, AI-assisted transcription, and automated multilingual content generation.

TECHNICAL HIGHLIGHTS
• Designed the full UI/UX across web, mobile, and wearable interfaces from concept to production.
• Digital workflows with conditional logic executed hands-free on RealWear HMT-1 wearables, with photo capture, validated inputs, and audit-ready reports on completion
• Offline-first mobile architecture for zero-connectivity field environments
• Real-time video on OpenTok, later migrated to AWS Chime without service disruption
• Post-call AI pipeline: Kinesis Video Streams, multilingual audio via AWS Polly, FFmpeg muxing, and CloudFront delivery with synchronized subtitles
• Event-driven serverless back end on AWS Lambda and Amazon EC2, async processing via Celery

Led the end-to-end design and delivery of United Way Brasil's digital learning platform, built to scale the Crescer Aprendendo +Digital program, a national initiative supporting families in social vulnerability situations across multiple Brazilian states.

I owned the full lifecycle from architecture design through production rollout and long-term evolution, translating complex social program business rules into a reliable, accessible digital product used by educators, coordinators, and families at scale.

TECHNICAL HIGHLIGHTS
• Architected and configured a serverless AWS infrastructure, replacing a legacy stack and reducing infrastructure costs by 90%.
• Translated multi-layered program logic, including enrollment flows, content delivery, user roles, and regional coordination into a cohesive platform.
• Designed for national reach, supporting simultaneous operations across several Brazilian states with distinct regional workflows.

Led the end-to-end design and delivery of the Clarisonic companion apps for iOS and Android, the official mobile experience for L'Oreal's flagship connected beauty device, the Mia Smart.

I owned the full mobile development lifecycle from UI/UX design and Bluetooth integration through API consumption, feature delivery, and production rollout across both native platforms.

TECHNICAL HIGHLIGHTS
• Designed the full UI/UX across iOS and Android from concept to production.
• Built native iOS (Swift) and Android (Java) apps consuming L'Oreal's REST API.
• Implemented Bluetooth Low Energy integration with the Mia Smart device, enabling real-time routine sync, intensity control, and usage tracking.
• Delivered personalized skincare features, including skin quiz, customizable cleansing routines, and per-zone intensity adjustments synced directly to the device.
• Built progress tracking, achievement system, and loyalty rewards with streak-based incentives.
• Integrated device management, including charge monitoring, brush head tracking, and a how-to video library.

Led the end-to-end design and delivery of The Visible City, a landmark digital initiative for the Museum of Vancouver, produced via Big BeanStalk Interactive. The project was recognized as the first augmented reality experience built by a cultural institution in North America.

The platform allowed users to walk through downtown Vancouver and hold their phone up to present-day locations to see what those same streets looked like in the 1950s, 60s, and 70s, overlaying historical neon sign imagery onto live camera views across two walking tours covering 40+ stories and 50+ signs.

TECHNICAL HIGHLIGHTS
• Engineered a custom AR engine from the ground up for iOS and Android using GPS, compass, and camera data to anchor historical overlays to real-world locations.
• Developed native iOS (Objective-C) and Android (Java) apps in English and French with AR, audio narration, and historical photo content.
• Built the public-facing website and custom administrative panel in HTML5 and JavaScript, with REST APIs fully integrated into both mobile apps.
• Designed the full UI/UX across web, admin, and mobile from concept to production.

Led the end-to-end hardware and software development of Wifialarm, an IoT security device created by GATSO in partnership with Grey Brazil's innovation department. The product transforms any standard Wi-Fi router into a motion-detection security system by analyzing disruption patterns in Wi-Fi signal frequency caused by physical movement, triggering real-time push notifications to the user's smartphone.

The project won 3 Bronze Lions at Cannes Lions Innovation 2016 and was featured in a campaign video in which I appeared as the lead researcher presenting the technology.

TECHNICAL HIGHLIGHTS
• Designed and built custom hardware using Intel Galileo, including the electronic circuit and physical device enclosure
• Developed the signal processing application in C++ to detect and interpret Wi-Fi wave disruption patterns
• Built native iOS and Android apps with real-time push notification integration
• Engineered the back-end infrastructure connecting device events to mobile notification delivery at scale
• Owned the full product lifecycle from R&D and hardware prototyping through software development and production rollout

Built the Chrome extension for The Colour of Corruption, a civic technology initiative by Grey Brasil for Reclame Aqui that made political corruption visible to every Brazilian citizen on every webpage they visited.

The extension parsed the DOM of any active page in real time, detected politician names using a keyword matching engine backed by a client-side database stored in IndexedDB, highlighted their names in purple, and displayed a mouseover popup with their corruption allegations and legal records. The tool worked on every website, social network, and search engine without exception, reaching millions of citizens across Brazil.

Awards: Cannes Lions Gold (Direct), Silver (Design), three Bronze (Media, Creative Data, and Cyber), Clio Silver, D&AD In-Book, shortlisted in 11 categories at Cannes.

TECHNICAL HIGHLIGHTS
• Built the complete Chrome extension in JavaScript, working across all websites, social networks, and search engines.
• Developed a DOM parser and politician name detection engine using IndexedDB for instant client-side lookup.
• Implemented real-time name highlighting and mouseover popup rendering with full corruption record details.

Developed the core real-time tracking application for Nike Rise 2.0, an award-winning interactive training ecosystem built for Nike in China, produced by AKQA. The project featured a fully reactive LED basketball court that responded live to player movement, delivering spectacular visual effects, performance tracking, and real-time coaching feedback.

The initiative reached millions of viewers through weekly shows and redefined the way basketball is coached and experienced, winning Webby Awards, ADC Gold, and APAC Cristal Gold for Best Creative Technology.

TECHNICAL HIGHLIGHTS
• Built the C++ application responsible for consuming and processing real-time positional data from the BlackTrax hardware tracking system.
• Integrated live player tracking data with the court's LED display layer, enabling sub-second reactive visual effects triggered by player position and movement.
• Engineered the data pipeline connecting physical player tracking to the digital performance and coaching ecosystem.

Built the campaign website for The Real Machado de Assis, a social impact initiative by Grey Brazil and Faculdade Zumbi dos Palmares to correct a historical racial injustice by revealing the true image of Machado de Assis, Brazil's greatest writer, who had been systematically portrayed as white for over a century.

The campaign reached approximately 230 million people worldwide, prompted the publication of his books with the corrected photo for the first time in history, and led to the update of his official portrait at the Brazilian Academy of Letters. Awards include Cannes Lions Bronze, D&AD Graphite Pencil, Clio Bronze, and El Ojo Silver.

TECHNICAL HIGHLIGHTS
• Built the platform in HTML5 and JavaScript, achieving a perfect 100% SEO score to maximize organic reach and ensure the campaign message ranked at the top of search results globally.
• Deployed the platform serverlessly on AWS S3 and CloudFront, ensuring high availability and fast global content delivery to support worldwide viral traffic at scale.
• Implemented downloadable corrected image assets, online petition system, and social sharing features to drive viral distribution.

Led the end-to-end design and delivery of Accord Awards, a Facebook campaign for Honda in which users could dedicate a personalized trophy to a friend by tagging them in the comments of specific brand posts.

The system automatically detected tagged comments, extracted both usernames, and generated a fully personalized video for each interaction, featuring the names of both the sender and the recipient rendered dynamically via programmatic video editing.

TECHNICAL HIGHLIGHTS
• Built an automated comment listener via Facebook Graph API to detect and parse tagged mentions in real time.
• Engineered a programmatic video generation pipeline using Python and FFMPEG, rendering personalized trophy videos at scale with dynamic name overlays.
• Developed a custom vetting and curation panel in PHP and MySQL, enabling the moderation team to review all interactions and prevent abuse before video delivery.
• Designed the full UI/UX of the campaign experience and admin panel from concept to production.

Led the technical direction and full-stack development of the digital hub for Compartilhe com Bauducco, Bauducco's 2020 Christmas campaign by CP+B Brasil, marking the brand's first repositioning in 23 years.

Users uploaded family video clips directly to AWS S3 that were automatically transformed into a personalized version of the brand's Christmas commercial. The system applied VHS-style aging effects and nostalgic visual filters to the footage, dynamically composited the family name onto a VHS tape placeholder using MoviePy, and delivered the finished personalized film via email.

TECHNICAL HIGHLIGHTS
• Engineered a fully serverless AWS architecture with direct S3 uploads and Lambda-triggered video processing, achieving 100% uptime throughout the campaign.
• Built the video pipeline using MoviePy and FFmpeg for VHS effect rendering, dynamic text compositing, and automated film assembly.
• Built the landing page and upload flow in PHP, HTML5, and JavaScript.
• Developed a vetting and moderation panel in PHP and MySQL for editorial oversight of all submissions.
• Implemented automated transactional email delivery of each personalized video at scale.

Built the full digital platform for Radio Fantasma, an Activision Brazil campaign promoting Call of Duty: Black Ops Cold War, produced with CP+B Brasil. The campaign successfully distributed 10,000 double XP vouchers to players across Brazil.

The experience immersed players in a live Cold War-inspired radio station at radiofantasma.com.br, broadcasting a themed playlist and encrypted transmissions in real time. Players who deciphered the codes and submitted them on the platform received double XP vouchers delivered via automated email, redeemable directly in-game.

TECHNICAL HIGHLIGHTS
• Built the campaign website in HTML5 and JavaScript, managing Photoshop asset structure and layer organization to ensure precise implementation and natural interaction behavior.
• Engineered a serverless Python back end with MySQL handling real-time code validation, voucher inventory management, and automated email dispatch at scale.
• Implemented rate limiting and API abuse protection to prevent code farming and guarantee fair distribution across all 10,000 vouchers.

Built an augmented reality iOS application for Bentley Motors that transformed the way customers experienced the vehicle by overlaying interactive 3D feature callouts directly onto the physical car in real time.

I led the full technical direction from concept to delivery, including defining and mapping all AR points of interest across the vehicle. I coordinated a professional photo shoot of the car to capture precise anchor points for the AR tracking system. Each vehicle component, including tyres, front grille, and key mechanical and design features, was mapped to a 3D overlay that appeared anchored to the physical car through the device camera, maintaining stable tracking as the user moved around the vehicle.

TECHNICAL HIGHLIGHTS
• Led the technical direction for the AR point-of-interest mapping methodology, defining the anchor strategy and coordinating professional photography for point extraction.
• Built the full native iOS application in Objective-C with a custom AR engine delivering real-time 3D overlay rendering anchored to physical vehicle features.
• Engineered stable real-time tracking that maintained 3D overlay alignment as the user moved the device around the car without losing registration.

Built an interactive kiosk installation for Arla Milk, deployed at a bus stop venue as part of a brand awareness campaign. The experience used Microsoft Kinect for PC to detect users in front of the screen and transform them in real time into 2D/3D skeletons, responding to their physical movements with pre-determined animations triggered by jumps and gestures.

The installation supported simultaneous multiplayer interaction, allowing multiple users to participate at the same time, and was fully localized into Chinese for international deployment.

TECHNICAL HIGHLIGHTS
• Integrated Microsoft Kinect SDK for real-time human skeleton tracking, detecting full-body joint positions, and mapping them to on-screen 2D/3D character representations.
• Built a real-time gesture and movement detection engine, triggering pre-determined animations based on user actions, including jumps and physical interactions.
• Engineered multiplayer support enabling simultaneous participation from multiple users in front of the kiosk display.
• Delivered full Chinese localization for international market deployment
• Deployed as a kiosk-mode application on Windows for unattended public installation.

Built an interactive store window installation for Ted Baker using Microsoft Kinect for PC. The experience turned passersby into active participants in a real-time physics simulation where branded fashion items rained down from the top of the screen.

Rather than mapping a skeleton, the system used blob detection to capture the user's full body silhouette as a dynamic physical object. The user's body became a collision surface in the simulation, allowing them to catch, deflect, and interact with falling Ted Baker products using their entire body in real time.

TECHNICAL HIGHLIGHTS
• Integrated Microsoft Kinect SDK with a custom blob detection algorithm to extract the user's full body contour as a real-time collision mesh.
• Built a real-time 2D physics engine where branded fashion items responded dynamically to the user's body shape and movements.
• Engineered the full kiosk-mode installation for unattended public display in a retail window environment.
• Distinguished the detection approach from skeleton tracking by treating the body as an organic, continuously updating physical surface rather than a set of fixed joints.

Built the Michael Kors Concierge, an in-store interactive totem running on a large touch screen display. The application allowed customers to browse the full product catalog, interact with items in a rich tactile experience, and build a shopping cart redeemable at the physical checkout.

A standout feature was the 360-degree product and model viewer: the full photo shoot was conducted specifically for the installation, capturing all products and models across multiple angles. Users could swipe directly on the screen to rotate products and models in real time, delivering the dynamism and depth of a physical try-on experience on a digital surface.

TECHNICAL HIGHLIGHTS
• Built the full application in C# using Windows Forms, optimized for large touch screen kiosk deployment in a retail environment.
• Engineered a real-time 360 viewer driven by sequential photo frames, enabling fluid swipe-to-rotate interaction for all products and models.
• Coordinated and integrated the full 360 photo production into the application asset pipeline.
• Built a shopping cart and checkout code generation system connecting the digital browsing experience to the physical point of sale.

Contributed to the development of Nizo, a critically acclaimed iOS filmmaking app built around the philosophy that "recording is editing." The app unified capture, grading, and editing into a single continuous workflow, allowing users to apply cinematic looks in real time while filming, then cut and add music without leaving the app.

The application supported 4K recording, manual camera controls, and a library of film-inspired looks rendered in real time via OpenGL, positioning Nizo as a reference tool for mobile cinematography on the App Store.

TECHNICAL HIGHLIGHTS
• Built in Objective-C with OpenGL-powered real-time look and filter rendering applied directly to the live camera feed during capture.
• Implemented the continuous capture-to-edit workflow, enabling users to record, apply looks, trim, and add music in a single uninterrupted session.
• Engineered the real-time video processing pipeline, balancing visual quality with performance on iOS hardware constraints.
• Supported 4K video output and manual exposure, focus, and white balance controls for advanced users.

Built the back end for AA1 Airport, an innovative interactive installation deployed in an airport venue featuring a large-format display running a Unity3D multiplayer game controlled entirely by passengers' smartphones.

Any visitor could open a public URL on their mobile device and instantly become a player, using their phone as a wireless joystick connected to the game via WebSocket. The system supported simultaneous multiplayer sessions with real-time responsiveness, turning the airport screen into a shared interactive experience accessible to anyone in the space without requiring app installation.

TECHNICAL HIGHLIGHTS
• Engineered the real-time WebSocket back end in C#, enabling any smartphone browser to connect and act as a live game controller.
• Built the multiplayer session management layer, handling concurrent player connections, input routing, and game state synchronization in real time.
• Integrated the back end with the Unity3D game engine running on the large-format display.

Built the official iPad application for The Mill, one of the world's leading visual effects and production studios, known for creating iconic work for the biggest global brands and advertising campaigns.

The app served as a premium portfolio and content platform, allowing clients and creatives to browse, watch, and save The Mill's work directly from their iPad. Built end-to-end, including the native iOS application and the full back-end API.

TECHNICAL HIGHLIGHTS
• Developed the full native iPad application in Objective-C with a polished, media-rich interface optimized for the iPad's large display.
• Implemented asynchronous and background video download, allowing users to queue and consume content offline without blocking the UI.
• Built a favorites system enabling users to save and organize selected works across sessions.
• Designed and built a complete PHP and MySQL REST API with a static JSON cache layer that was automatically invalidated and regenerated on CMS content changes, ensuring fast API responses without unnecessary server load.

Built an augmented reality iOS application for Porsche that used QR Code markers placed across the physical vehicle to trigger dedicated interactive screens for each car component, delivering a rich digital layer on top of the showroom experience.

Each QR Code corresponded to a specific vehicle feature and launched a tailored interaction screen. For example, scanning the headlight area opened a screen with a slider that animated the headlights turning on in real time, replicating the physical feel of the feature through a direct touch interaction.

TECHNICAL HIGHLIGHTS
• Built the full native iOS application in Objective-C with a QR Code scanning engine triggering component-specific AR experience screens.
• Designed and implemented a distinct interaction model per vehicle feature, including real-time animated sliders, swipe controls, and gesture-driven feature demonstrations.
• Engineered the full AR flow from QR Code detection through screen transition and interactive component rendering.
• Led the technical direction for the QR Code placement strategy across the vehicle to maximize the showroom walkthrough experience.

Built the back-end platform for Laureus, the global sports foundation founded by Richemont and Daimler that uses the power of sport to transform the lives of young people worldwide.

Delivered a complete Ruby on Rails back end powering an exclusive content platform with user authentication, role-based access control, and a caching layer to ensure fast, reliable content delivery at scale.

TECHNICAL HIGHLIGHTS
• Built a full RESTful API in Ruby on Rails serving all platform content, authentication flows, and user session management.
• Implemented role-based authentication to gate exclusive content access for authorized users.
• Engineered a caching layer to optimize API response times and reduce server load for high-frequency content requests.
• Designed the full back-end architecture from data modeling through API contract definition and deployment.

Built the Android augmented reality application for Cheirinho Prolongado, a Johnson & Johnson marketing campaign for their long-lasting fragrance product line. The app used the product packaging itself as the AR trigger, launching an immersive interactive experience when the label was detected by the device camera.

The application was built with Android NDK and OpenGL for high-performance real-time video processing, enabling background removal directly from the live camera feed and smooth AR overlay rendering anchored to the physical product packaging.

TECHNICAL HIGHLIGHTS
• Built the full native Android application in Java using Android NDK for low-level performance-critical processing.
• Implemented real-time video background removal using OpenGL, isolating the subject from the live camera feed on-device without external processing.
• Engineered product packaging recognition and tracking to detect the label and trigger the AR experience with stable registration.
• Integrated a music player into the AR experience, delivering synchronized audio as part of the immersive campaign interaction.
• Delivered a complete AR experience from packaging scan through interactive digital content playback.

Built a complete enterprise Android application for AES Eletropaulo, one of Brazil's largest electricity distribution companies serving millions of customers in the São Paulo metropolitan area.

The app was deployed on field operator tablets and enabled real-time invoice renegotiation workflows directly at the customer's location, connecting field agents to AES back-end systems through live API integrations.

TECHNICAL HIGHLIGHTS
• Developed the full native Android application in Java with XML-based UI layouts using Android Studio.
• Built a dynamic questionnaire engine for real-time electricity invoice renegotiation, consuming AES REST APIs and processing responses instantly in the field.
• Integrated the device camera for on-site electrical panel photography, attaching images directly to customer records and service orders.
• Implemented GPS tracking to monitor the real-time location of each tablet and field operator across the São Paulo metro area, enabling operational oversight and fleet coordination.
• Delivered a complete field operations platform replacing manual paper-based processes.

Built XP Responde, a Chrome extension for XP Investimentos, one of Brazil's largest investment platforms, designed to bring contextual investment information directly into the user's browsing experience.

The extension uses a context-aware keyword detection engine that parses the DOM of any active web page in real time, identifies financial terms, and surfaces their definitions and relevant XP resources inline, without requiring the user to leave the page.

TECHNICAL HIGHLIGHTS
• Developed the full extension in JavaScript and HTML5, following Chrome Extension architecture best practices.
• Built a rule-based NLP parser for real-time DOM traversal and financial keyword detection.
• Embedded a complete financial glossary database using IndexedDB, storing term definitions and associated XP content entirely client-side for offline availability and instant lookup performance.
• Used LocalStorage for persistent user preferences and session state across browsing sessions.
• Delivered a seamless, non-intrusive UX that surfaces contextual investment content inline within any webpage.

Built the full back-end infrastructure for The Fabric of America, an Xfinity digital campaign created by GALLEGOS United and CANVAS United in the United States. The platform invited Americans to record and share their voice, their gratitude, and their wishes for the future, with each submission becoming a digital thread woven into a living, interactive virtual American flag.

The experience celebrated the diverse voices of Hispanic Americans and was published in October 2020, at the height of a pivotal year for the country.

TECHNICAL HIGHLIGHTS
• Engineered the back end in PHP and MySQL to handle user-generated content submission, storage, and retrieval at scale.
• Integrated the Twitter SDK to enable social sharing and real-time content ingestion from the platform.
• Configured AWS infrastructure and CDN delivery to ensure fast, reliable global access to media assets and user submissions.
• Designed and implemented the content pipeline connecting user voice recordings to the interactive flag visualization layer.

Built the campaign website for Solar Bottle, a limited edition product launch by Sol, Heineken Brasil's premium lager brand. The launch featured photosensitive bottles that revealed positive messages when exposed to sunlight, available nationwide in Brazil from January 2022.

The platform combined a newsletter registration flow with an exclusive, limited-access activation restricted to 200 users, who could unlock participation by scanning specific QR Codes distributed at select touchpoints.

TECHNICAL HIGHLIGHTS
• Developed the full website in PHP, HTML5, and JavaScript, including animated product presentation and responsive layout.
• Built a newsletter registration system and a controlled access flow limited to 200 participants, enforcing QR Code-based validation to prevent unauthorized entries.
• Integrated Xerpa for participant identity and eligibility verification.
• Leveraged DynamoDB for fast, scalable storage of user registrations and QR Code redemption state.
• Deployed serverlessly on AWS S3 and CloudFront for high availability and fast global content delivery.