Fingertip Menu [AR]

Tried the fingertip menu concept I shared last year for my voxel editor. I hoped that over the year, hand-tracking would improve, or we could get some non-computer-vision system to track hands in Quest to mitigate this ridiculous amount of false positives for non-index fingers... Anyway, the interaction itself is fun, but with a set of restrictions:

1) System UX collision: Obviously, on Quest, it interferes with the system menu call. Unfortunately, this pattern is unusable until Meta moves the system menu calls elsewhere.

2) Anatomical restriction I: At the moment, it will be an issue if you want to scale the number of items on the menu. Four is max.

3) Anatomical restriction II: Works well only for anthropomorphic creatures or beings with developed limbs that resemble human hands to leverage the pinch mechanics.

4) Interaction Speed and Cognitive Fatigue: Considering all these technical limitations, it's a slow interaction at the moment. You must be fully aware of what you do to perform selection correctly due to a lack of hand-tracking preciseness (you can't rely on your muscle memory).

Here is a prototype — https://github.com/Volorf/xr-prototypes#fingertips-menu

Enjoy!

Oleg Frolov
Experiment with Interaction Design. Explore AR/VR.
Get in touch

More by Oleg Frolov

View profile