Hand Tracking & Haptics VR, The Art of Shadows
In the Art of Shadows VR experience you are a cast as a great storyteller who wishes to learn the ancient traditions of hand shadow puppetry and under the tutelage of the shadow master, you use your own hands to grasp the basics of shadow play, create a magical realm that you can reach out and touch. Working in conjuction with ultraleap the brief was to prototype a storytelling experience for VR utilising their development kit by combining visual, audio and haptic stimuli.
The VR setup comprises two environments: outer, where the performance is staged and inner, a creation stage for constructing the story. The participant is centred in the space to allow the shadow world to build around them. The prototype was made in Unity and integral to it was the recognition of gestures. Hand shapes were designed for the Butterfly, Tree and Flower and each is tracked in Unity using detector logic. To demonstrate the haptics, it was decided to focus on the Butterfly and what landing on a finger would feel like.
Role: Concept Design, Project Management, Real-Time Interactive, XR Development, XR Prototyping, Research Paper.
Completed 2020, Copyright Ultraleap. Click Here