Reminds me of the Magic Leap. Or even the Kinect. That use case is even more niche than VR, but setup some tracking gloves and you can perform gesture based actions on your PC (don't really NEED the gloves, but it improves precision without needing a special spatial comera).

Crude, but it's technically possible.