News for hackers. Stuff that matters.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by wtallis on Tuesday January 30, 2024 @03:51PM (#39195647)
Streaming an arbitrary collection of windows instead of a single finished, composited framebuffer increases the bandwidth requirements by at least an order of magnitude. That's never going to work well over WiFi.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by ehsankia on Tuesday January 30, 2024 @04:31PM (#39196130)
As long as the total number of pixels is less, I don't see what that has to be true, at least bandwidth wise? Compute wise, the vision might have to do slightly more to separate the buffer and composite them into the AR view in different places, but the bandwidth should be direction proportional to the number/size of each window. If I can fit all the windows on a 4K screen, then I don't see why the software can't split that and lay it out separate in my view instead of in a single rectangle.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by wtallis on Tuesday January 30, 2024 @09:18PM (#39198934)
It seems pretty obvious that nobody wants to be limited to the total number of pixels being merely equivalent to tiling across a 4k screen.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by saagarjha on Wednesday January 31, 2024 @03:43AM (#39201497)
Some of the windows will be obscured by others. If you stream a 100 windows to visionOS, it's possible to lay them out so that none of them cover each other and you have to render them all. On a flat screen there is a limit to how many pixels you need to paint.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by jayd16 on Tuesday January 30, 2024 @04:54PM (#39196406)
Just compress the stream. Total pixels increase the vram on the device but popping out a static window shouldn't take any more than a trivial amount of streaming bandwidth.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by wtallis on Tuesday January 30, 2024 @06:13PM (#39197309)
Everything is already compressed. Uncompressed 1080p is 3Gbit/s, which is already well beyond what's actually achievable with WiFi. Allowing an unbounded number of window surfaces to be streamed invites people to use it in a way that current technology simply cannot provide the kind of slick experience that Apple needs from this product.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by jayd16 on Wednesday January 31, 2024 @11:37AM (#39205831)
Seeing as you have the eye tracking you could probably greatly reduce the FPS/bitrate of windows that are out of gaze. This kind of foveated rendering seems to already be used in their ecosystem so I assume its sufficiently slick for Apple. Apps will sleep when not being gazed and such.

This allows you to restrict full bitrate to a single window with a maximum resolution and keep the user experience high and astonishment low.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by saagarjha on Wednesday January 31, 2024 @03:44AM (#39201504)
Keep in mind that you are popping out a static window 60 times a second or so.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by vunderba on Tuesday January 30, 2024 @06:42PM (#39197629)
Use the touted eye tracking feature and compress that particular applications stream inversely to how much the user is focusing on it within the Vision Pro.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by wtallis on Tuesday January 30, 2024 @09:15PM (#39198908)
Does foveated rendering work with the extra latency of a round trip over WiFi? I can certainly see this working fine on a head tracking scale, but I'm less sure about eye tracking. I also wonder if existing video compression hardware can actually make use of such outside feedback to adapt bitrate and quality with the necessary flexibility.