The pandemic is the best opportunity FB will ever have to push VR into the mainstream. Zuck has also been playing up that it could replace business travel post pandemic and there have been leaked specs for a Quest Pro that would deliver a very cutting edge productivity experience.
I woke up thinking, "I need to invest in drone deliveries!"
Lighter-weight headsets is something necessary but also something that is in sort of a weird spot. The Quest 2 is actually a lot heavier than average, because it's standalone. As cool as it is, it's regressive in some interesting ways.
For better displays, there's already some pretty impressive displays these days if you don't mind jumping up in price a few notches. Enthusiast-range, for sure, but still consumer models.
As an aside, a handy cheap way to get more screens in VR with Oculus Link is to insert a headless HDMI plug into your video card. This also works for creating new screens in VR using Immersed although they claim that the virtual screens (paid feature) work better.
The oculus team put together a seriously jawdropping demo of facial tracking using a few cameras in a headset, combined with a lot of AI. The prototype was from a couple years ago. I can't wait until it makes it into commercial headsets. I wonder what the hold up is?
Well worth a look if you haven't seen it:
Curious, but why not AR for productivity rather than VR? Both could work, and AR is less invasive.
E.g. the very best AR stuff you can buy right now is still moderately-bright glowing pixels on top of whatever you're currently looking towards. So if you have too much contrast in the background, or actual light sources, they show right through and ruin much of the visual clarity.
As much as I like AR as a concept, it's much further from "ready". It has all the complexities of VR, plus real-world tracking, plus visual overlay - it'll necessarily trail VR until those latter two are "good enough", and they certainly are not at the moment.
Last I saw, that opaque layer's pixel density was far too coarse (so it blocked too much or too little - it needs like >10x higher density than the highest density consumer screens out now), and every tech I've seen has had a fundamental issue with focus - we can project AR pixels at comfortable focus ranges with complex enough techniques, but nothing exists to project "darkness", so it's at an entirely different visual and focal distance as the pixels, and it never looks quite right.
On top of that, you can't really use it to make semi-opaque pixels - you can only darken, and draw brighter stuff on top. So even if you solve ^ all that, you still have to accurately track the world, figure out what's being occluded, and re-draw that along with the pixel you want to draw. Without blocking vision, so the cameras to do all this can't see exactly the same thing you see.
... so every AR headset just adds a pair of literal sunglasses behind it all to dim the world so things don't look quite as bad, and that's the best we have now.
In VR with a couple cameras, you... just draw a semi-opaque pixel on top. And it looks perfect.
1. Eye and face tracking. The author mentions lip syncing and hand tracking. That goes a long way, but it doesn't recreate the video experience to me. There are a few vtubers out there that are doing some seriously impressive tracking, but it requires tons of special equipment at the moment. Once this gets resolved in a consumer model, I think things will really shine for virtual presence.
2. Lighter weight headsets. For longer sessions, a custom headstrap helps a ton, but even still lighter headsets will go a long ways to helping here.
3. Better lenses and better displays. The lower res means you're really forced to work at huge virtual screen sizes, as the author mentions. While this is the least needed item in this list for basic productivity, the screen door effect definitely creates a barrier some of the time.
I highly anticipate that we'll see a sizable portion of the population change over to VR for productivity within ten years. It has huge potential, especially with the remote work environment many are in these days. I would love to be able to feel the presence of people around me again, while still not having a commute or the risks associated with being physically in the same room.