Gesture Recognition

Building on the Introduction to Virtual Reality, OpenXR Hand-Tracking, and Gesture Recognition in Unreal Engine tutorial, this slightly more advanced tutorial will dive deeper into the following topics:

• Transitioning seamlessly between motion controller and hand-tracking modes in Unreal Engine.
• Adding custom debugging gizmos to improve development and testing workflows.
• Visualizing debug virtual hands by incorporating the custom gizmos.
• Animating virtual hand meshes with OpenXR hand-tracking data, moving beyond basic joint representation with cubes.
• Re-using and adapting the gesture recognition code from the introductory tutorial to integrate with the new animated virtual hand meshes.

This guide will help you take your VR projects to the next level with polished and practical implementations.

Here’s a lesser-known fact about me. Once upon a time, when it was just me and the dinosaurs… Okay, maybe not that far back, but long before VR headsets, the Metaverse, and the social media craze, I used to teach people things for 8 years! I loved it so much that, honestly, I could talk for hours (don’t worry, I won’t in this video)!

Anyway, enough of my rambling! Recently, I rediscovered that passion for teaching, and I’m thrilled to kick off a VR tutorial series in Unreal Engine. That’s why, as the introductory step into this series, we’re diving hands-first into the fascinating world of virtual reality.

But, before we jump in, make sure to hit that subscribe button so you don’t miss any of my VR adventures.

Ready? Let’s bring those virtual hands to life!

Find the link to the video tutorial and the project repository down below.