João Tiago Pinheiro Neto Jacob

Grappher is a Unity node-based programming tool. It allows for graphs to be stored in the cloud and remotely deployed to a game, even if the game is already running (in, say, a mobile device). This tool aims to ease mobile game development and parametrization and lay the foundations for adaptive games, as it exposes sensor and analytics data to the developer.

This tool consists of a game lesson plan authoring tool developed for the H2020 Beaconing project; it enables the allocation and parametrization of mini-games in narrative key points during a game and was made using HTML5 (DOM and Canvas).

Stablecargo is a dynamic stability container loading problem simulator that I developed. It uses a custom-made OpenGL-based renderer—that I also developed, together with a couple of colleagues (CGFLib)—and uses the Bullet Physics Engine. It also features simple shader programming (alpha blending two textures to a frag).

The game, CTRL-ALTruism, is a competitive arcade brawl game made for a local game jam, made entirely in Unity. Once a user opens the mobile application of the game, the player automatically joins a local session as a new player. The board adapts its geometry to accommodate the correct number of players. I was responsible for the gameplay and networking programming.

Geostream is a Unity framework that I developed. It aims to collect geographical information from different sources (Openweather, Sunrise, OpenStreetMaps, Google Maps, Bing Maps, MapQuest, and Google Elevation), combine this information, and enable the procedural recreation of an environment. As the world is divided into tiles, as the reference object moves, the new tiles are loaded and created or discarded as needed.

GhostStand is a mobile VR exergame that uses an Android Wear device to serve as a controller. The player can swing a sword around to hit incoming enemies. Depending on the player's heart rate (effort), the game changed the difficulty (spawn rate, speed, and resistance of enemies). The player features an IK for hand/arm and head movements.

Jensie is a Three.js and Laravel web application that allows visitors to create rooms and populate them with furniture that I have created. Rooms can be created parametrically or by drawing their footprints. Finally, the user may visit the created room in VR if the device supports WebVR. A simple post-processing stack was also implemented for full-screen 3D view, featuring ambient occlusion, bokeh, vignetting, and anti-aliasing for high-quality screenshots.

A Unity script that was developed as part of a contract project. It allows for a 2D shape to be parametrically moved, rotated, and bent in any way via lofting. It creates the minimum specified geometry detail to achieve the desired effect (as the tube is bent, extra geometry is added).

See Hear and Touch No Evil is a competitive/collaborative 3D isometric turn-based exploration game. Each player has a "sense" that allows for space exploration. The goal of the game is for the player to reach the exit. Players must collect oxygen and batteries and must avoid or defeat enemies.

I was responsible for the gameplay programming and OSC integration of this Unity game. The game also features tracker music via OSC, allowing for the music track to change depending on the current player's status.

This experimental project aims to foster expressiveness and agency through the physics-based concatenative sound synthesis in virtual environments using photogrammetric models.

I was responsible for all the programming and OSC integration. Parameters are extracted from the physics engine and from the collision points' model's geometry, materials and maps and are sent to the CSS engine for real-time audio synthesis.

WaveCrash is a single-player/split-screen arcade game where a player controls a boat on a planet. The boat can only move with the recoils from the shots. These shots create explosions and waves that also affect the movement of the ships. All objects follow Newton's law of universal attraction and are attracted to the planet, moon, and sun (meaning that projectiles and boats may be blasted into orbit).

I was responsible for the game's design, gameplay, and AI programming. We won first place in the game jam.

rePAIR is a 2P cooperative game where each player controls a brother. One of the brothers has a flashlight and a marker that is used to light the board and select predefined labyrinth tiles that have to be placed on the board. The other brother has a laser pointer with which he will "play" the labyrinth created by the other one, without hitting any of the walls.

I was responsible for the game design, gameplay and lighting. The board's content is actually rendered off-screen and placed as a texture on the board.

The Museu da Língua Portuguesa application was developed as a showcase for a museum creation proposal. The application is a Unity Cardboard VR application that allows users to explore the museum through interconnected 360° stereo renders and features Ambisonics audio and narration.

I was the sole developer of the application (with assets provided by a sound designer and 3D modeler).

Luzas is a location-based augmented reality game, developed in Unity using Vuforia. The player must physically go to certain spots in the city of Lisbon and solve augmented reality puzzles. Once all puzzles have been completed, the user is asked to go to a new location where they can claim their prize: a photo taken from atop of a Christmas tree, sent to the application.

I was responsible for the development of the location-based part of the game, as well as puzzle completion detection. The app went live on Christmas of 2018.

MelhorTarifa was a mobile application and website meant to allow users to compare gas and electricity tariffs easily.

I was responsible for the native Android version development, as well as the web API

PresentR is a presenting companion application for Android Wear devices. The user can create presentation section timers and vibration patterns so that during a presentation the wearable may warn the presenter if the presentation is ahead or behind time, discreetly.

SIMUSAFE.eu is an H2020 project.

My role in this project was to develop an interoperable pedestrian behavior simulation module to be integrated into the simulator. This was developed using Unity3D, Python, and statistical models from the data collected by the project's partners.

Human-computer Virtual Reality Interaction (HCVRI) was a module I developed to ease the implementation of interactivity in the Cardboard VR application. It follows a gaze-based interaction principle but allows developers to very easily (no programming required) to match UnityActions with radial, hierarchical choices menus.

Nutriscience was a platform that allowed children to share their family recipes and complete nutritional challenges and mini-games. It featured cross-Moodle authentication, mini-games, and a mini-social network built around schools, families, and recipes.

I was the sole architect of the platform and implemented its Moodle integration, back office, and front end (Laravel) as well as some of the mini-games (Unity).

The "Banco de Sangue Animal" Android app was developed and maintained by me up until 2019. It allowed vets to calculate the dosage of blood components that are to be used for cats/dogs transfusions, as well as peruse materials related to the specifications of these components.

This website allows alumni to find information regarding the University of Oporto, as well as news and events.

I was one of the two developers responsible for the implementation of the website in WordPress.

This website presents the works of art that are part of the Ilídio Pinho Foundation Collection.

I was one of the two developers, building the website's front end and back end. I was responsible for the database design.