Eye-tracking Numeric Keyboard

Prototyped a numeric keyboard with eye-tracking and hand-tracking inputs similar to what we saw on Apple's Vision Pro demo. I used Oculus Integration and ran it on Quest Pro (it's the only Quest that supports eye-tracking).

It feels very natural and familiar. We already use the same principles for regular keyboard-based, non-blind typing. First, you visually allocate a target, and then your hand confirms an intended action. But the eye-tracking version is less laborious since this hand confirmation is remote, and you don't need to "physically" interact with the keyboard.

I have a few more keyboard ideas for an eye-tracking-based input. Share the prototypes later. But so far, it's the best way to interact with the UI system in the XR medium I have ever experienced. I can't wait to see when it will become mainstream.

Stay tuned:

Dribbble — https://dribbble.com/Volorf

GitHub — https://github.com/Volorf

Twitter — https://twitter.com/Volorf

Instagram — https://www.instagram.com/olegdesignfrolov/

Oleg Frolov
Experiment with Interaction Design. Explore AR/VR.
Get in touch

More by Oleg Frolov

View profile