I feel like the VisionPro is a demonstration of what it takes technically. All the frameworks are fleshed out. The work is done and in x-number of years it will take off or the various pieces will be absorbed into other products.

Replying to myself but...

Imagine just the eye and hand tracking with no screens. That could be a much smaller device and one can trade the screens for an interactive environment.

Maybe Aerodrums should hire some programmers to write an app that just projects a drum set:

https://www.youtube.com/watch?v=CavlglPYVvQ

edit:

They already seem to have a beta VR application: https://aerodrums.com/3d-updates

Yann here, Aerodrums co-founder / developer.

Thank you for the plug. We're doing a Kickstarter right now for Aerodrums 2.

It will have support for VR passthrough. We'll add support for Apple Vision Pro and Meta Quest 3 as soon as they make it possible (if anyone has connections to speed that up, I am interested).

The project page is here: https://www.kickstarter.com/projects/aerodrums/aerodrums-2-a...

Do you think aeromarimba would be feasible with VR?

Air drumming feels much nicer with drumsticks. You actually get tactile feedback this way if you use a relaxed grip and let the butt of the stick hit your palm.

I make Aerodrums and that operates at 125Hz for the mocap. As far as I understand, Apple Vision Pro tracks hands at 83Hz. They would need to improve that (and provide developers what they need to do a good job determining the position of the drumstick tip), for an air drumming app to be possible without accessories that plays to a musical instrument standard.

I've replied elsehwere in the thread plugging our live Kickstarter for Aerodrums 2, check it out, it only has 7 days to go.