Accessible VR Hand Menu Interaction

Accessible Hand Menu Interaction — a quick prototype created in Unity exploring menu access using one hand. 👋

Our interactions with phones and computers have conditioned us to efficiently perform actions using a single hand. However, navigating a 3D spatial environment is far more complex, often requiring full-body movements or the use of both hands to access certain elements.

It's important to recognize that not everyone is always able to do that. Microsoft has provided excellent resources on inclusive design, emphasizing that disabilities can be not only permanent but also temporary or situational.

How many times have you struggled to use your phone with just one hand, especially when the screen was too large to reach comfortably?

With this in mind, I focused on devising an accessible means of accessing the XR menu. I drew inspiration from the interaction pattern of using the Apple Watch Ultra through gestures and interacting with the system menu found in Oculus.

I expanded upon this concept by incorporating additional buttons. This could involve mapping specific menu tabs to the remaining fingers, allowing users to access their desired tab even more swiftly.

To enhance accessibility further, especially in relatively simple experiences that don't require an extensive array of buttons, the same menu shortcuts could be available on both hands.

This way, users can interact seamlessly with the experience without being constrained to use either their left or right hand. ☀️