AR and VR Developer in Mountain View, CA, United States

I developed a VR demonstrator for the Intelligent Industrial Production Ecosphere (IIP-Ecosphere), a project that's uniting companies within the land of Lower Saxony in Germany. More than 50 organizations are participating, including Volkswagen, Sennheiser, and several universities.

The VR demonstrator will be the face of the project and shown to visitors at exhibitions. It represents the structure of the IIP-Sphere as a landscape with various groups of buildings, each associated with the project participant, and every participant has its own demo space inside their building.

I developed this escape room experience for VR arcades. The storyline and design are based on those provided by the concept designer and the writer. The VR experience itself is multiplayer software designed for use with a VR headset and backpack PC. Think of an escape room on steroids and in VR. It's free-roaming, in that movements of the users are translated one-to-one from the real world to the virtual world.

The advanced version of the VR experience has rough replicas of virtual objects in reality, exactly in the same place where they are expected to be. As the result, the player can not only see but also literally touch the virtual objects. This greatly enhances the player's immersion experience.

While working for a research institute in Singapore, I led the complete development of two visualization frameworks for the custom-built, bowl-shaped 320-degrees Cave Automatic Virtual Environment (CAVE) with five active stereo-projectors. The frameworks allowed researchers to easily extend their projects to the CAVE. This saved the institute $280,000 by replacing their third-party visualization framework with the ones I developed.

Using haptic interaction with 3D volumetric medical data and force-feedback devices, I designed and developed a novel virtual reality system that allows people to feel virtual objects.

The system was sponsored by a Siemens/DAAD Ph.D. scholarship. It was exhibited during CeBIT international computer exhibitions in 2013 and 2015 with more than 3,000 people visiting the stand, including politicians. It was also recognized in a German newspaper, written about in published research papers, and presented at international scientific conferences. Last but not least, the haptic interaction part of the MultiScaleHuman project was based on my work.

I built a highly optimized, real-time face analysis system for a low-performance target platform. The system does anonymous face detection and tracking and age/gender classification. It is one of two best-in-class systems; only one other system in the world can operate with comparable performance and accuracy and fulfill all the requirements. The system I built can work with many faces at the same time, and its modular structure allows it to be extended to other use cases.

While leading the complete project, from scoping requirements to launch, I also created the complete pipeline, from collecting and annotating training data to creating machine learning models. The system is now the very core technology for the client's business case.

While working on TurboCAD at SoftDev SPb, I designed and developed a mesh simplification tool. This tool reduces the number of triangles in the given model to the desired count while maintaining the best "quality." It's based on the QSlim algorithm and is particularly useful for models with such a huge number of triangles that they can't be interactively rendered or manipulated without being simplified.

I organize and moderate AR Berlin meetups where speakers from the industry present their work and share their learnings, tips and tricks, and new technologies. We've had 14 events so far, with more to come.