Its very difficult to change a mindset or culture in big companies. Existing VR companies were too invested in using a controller. Similarly back in the early smartphone days all the big companies thought that smartphones must have physical keyboard.
If everything is designed for your controller, the eye interface may not work well due to lack of software optimization.
Which means it’s just an expensive battery hogging extra weight you don’t need.
Apple has a stronger combination of hardware design, software implementation skills, and UX expertise, than any company in the world.
Not only do they have two cameras per eye, and all the hardware for wide angle out-of-view hand tracking, they had to consider:
Privacy: the user’s gaze is never delivered to your process when your native UI reacts to their gaze. Building this infrastructure to be performant, bug free and secure is a lot of work. Not to mention making it completely transparent for developers to use
Design: they reconsidered every single iOS control in the context of gaze and pinch, and invented whole new UI paradigms that work really well with the existing SDK. You can insert 3D models into a SwiftUI scroll view, and scroll them, and it just works (they even fade at the cut off point)
Accessibility: there is a great deal of thought put into alternative navigation methods for users who cannot maintain consistent gaze
In addition to this they clearly thought about how to maintain “gazeable” targets in the UI. When you drag a window closer or farther it scales up and down maintaining exactly the same visual size, trying to ensure nothing gets too small or large to gaze at effectively
There are so many thousands of design and engineering decisions that went into making gaze and pinch based navigation work so simply, so I can understand how it hasn’t been done this effectively until now
> The hardware needed to track eyes and hands in VR has been around for over a decade, and it’s Apple unique ability to bring everything together in a magical way that makes this UI superpower the most important achievement of the entire Vision Pro product, without a shadow of doubt.
So they had all the pieces, but only Apple put it together and realized that you'd need a VR equivalent of point-and-click? If that's actually true, it's sad.