News for hackers. Stuff that matters.
Re:Steam Frame by Night_Thastus on Wednesday November 12, 2025 @01:38PM (#45904028)
The whole "foveated streaming" sounds absolutely fascinating. If they can actually pull off doing it accurately in real time, that would be incredible. I can't even imagine the technical work behind the scenes to make it all work.

I'd really like to know what the experience is like of using it, both for games and something like video.

Re:Steam Frame by pixelpoet on Wednesday November 12, 2025 @01:59PM (#45904434)
There's an awesome shader on shadertoy that illustrates just how extreme the fovea focus is: https://www.shadertoy.com/view/4dsXzM

Linus the shrill/yappy poodle and his channel are less than worthless IMO.

Re:Steam Frame by jasonjmcghee on Wednesday November 12, 2025 @02:10PM (#45904644)
When you full screen this, it's crazy how tiny the area that spins is. For me it's like an inch or inch and a half on a 32 inch 4k display at a normal seated position.

(If I move my head closer it gets larger, further and it gets smaller)

Re:Steam Frame by Night_Thastus on Wednesday November 12, 2025 @02:32PM (#45905089)
Imagine if we could hook this into game rendering as well. Have super high resolution models, textures, shadows, etc near where the player is looking, and use lower LoDs elsewhere.

It could really push the boundaries of detail and efficiency, if we could somehow do it real-time for something that complex. (Streaming video sounds a lot easier)

Re:Steam Frame by ziml77 on Wednesday November 12, 2025 @03:49PM (#45906452)
Foveated rendering is already a thing. But since it needs to be coded for in the game, it's not really being used on PC games. Games designed for Playstation with the PS VR 2 in mind do use foveated rendering since they know their games are being played with hardware that provides eye tracking.
Re:Steam Frame by scld on Wednesday November 12, 2025 @03:00PM (#45905586)
Game rendering is what they're talking about here. John Carmack has talked about this a bunch if you'd like to seed a google search.
Re:Steam Frame by FeepingCreature on Thursday November 13, 2025 @03:42AM (#45912388)
Not quite: you can use it for games rendering, but with a Wifi adapter you more importantly want to use it for the video signal, and only transfer highres in the area you're looking at. A 4k game (2048*2048*2 screens) is 25gbit uncompressed at 100fps, which would stress even Wifi-7. With foveated rendering you can probably get that down to 8gbit easy.
Re:Steam Frame by LtdJorge on Thursday November 13, 2025 @07:12AM (#45913974)
Not just stress WiFi 7, even if the theoretical limit is 23Gbps, you’re not getting anywhere close to that sending to just one device.
Re:Steam Frame by rtkwe on Thursday November 13, 2025 @10:55AM (#45916415)
Valve is applying it to the streamed view from the computer to reduce the bandwidth requirements it's not actually doing foveated rendering in the game itself because not all games support it.

Foveated streaming is just a bandwidth hack and doesn't reduce the graphic requirements on the host computer the same way foveated rendering does.

Re:Steam Frame by pixelpoet on Wednesday November 12, 2025 @05:49PM (#45907994)
As a lover of ray/path tracing I'm obligated to point out: rasterisation gets its efficiency by amortising the cost of per-triangle setup over many pixels. This more or less forces you to do fixed-resolution rendering; it's very efficient at this, which is why even today with hardware RT, rasterisation remains the fastest and most power-efficient way to do visibility processing (under certain conditions). However, this efficiency starts to drop off as soon as you want to do things like stencil reflections, and especially shadow maps, to say nothing of global illumination.

While there are some recent'ish extensions to do variable-rate shading in rasterisation[0], this isn't variable-rate visibility determination (well, you can do stochastic rasterisation[1], but it's not implemented in hardware), and with ray tracing you can do as fine-grained distribution of rays as you like.

TL;DR for foveated rendering, ray tracing is the efficiency king, not rasterisation. But don't worry, ray tracing will eventually replace all rasterisation anyway :)

[0] https://developer.nvidia.com/vrworks/graphics/variableratesh...

[1] https://research.nvidia.com/sites/default/files/pubs/2010-06...

Re:Steam Frame by Taterr on Thursday November 13, 2025 @02:35AM (#45911882)
I think you could do foveated rendering efficiently with rasterization if you "simply" render twice at 2 different resolutions. A low resolution render over the entire FOV, and a higher resolution render in the fovea region. You would have overlap but overall it should be less pixels rendered.
Re:Steam Frame by FeepingCreature on Thursday November 13, 2025 @03:55AM (#45912487)
I believe the standard way is to downgrade the sampling density outside the area you're looking, see https://docs.vulkan.org/samples/latest/samples/extensions/fr... . Optimally you could attach multiple buffers with different resolutions covering different parts of clipspace, saving vram bandwidth. Sadly this is not supported currently to my knowledge, so you have to write to a single giant buffer with lower sample resolution outside the detail area, and then just downsample it for the coarse layer.
Re:Steam Frame by globular-toast on Thursday November 13, 2025 @05:44AM (#45913304)
That's foveated rendering. Foveated streaming, which is newly presented here, is a more general approach which can apply to any video signal, be it from a game, movie or desktop environment.

They are complementary things. Foveated rendering means your GPU has to do less work which means higher frame rates for the same resolution/quality settings. Foveated streaming is more about just being able get video data across from the rendering device to the headset. You need both things to get great results as either rendering or video transport could be a bottleneck.

Re:Steam Frame by ehnto on Wednesday November 12, 2025 @09:48PM (#45909903)
That's quite harsh, and definitely not accurate.
Re:Steam Frame by globular-toast on Thursday November 13, 2025 @04:19AM (#45912673)
That's crazy. I feel dumb for initial thinking it was somehow doing eye tracking to achieve this, despite having no such hardware installed.

I would be curious to see a similar thing that includes flashing. Anecdotally, my peripheral vision seems to be highly sensitive to flashing/strobing even if it is evidently poor at seeing fine details. Make me think compression in the time domain (e.g. reducing frame rate) will be less effective. But I wonder if the flashing would "wake up" the peripheral vision to changes it can't normally detect.

Not sure what the random jab at Linus is about.

Re:Steam Frame by LtdJorge on Thursday November 13, 2025 @07:10AM (#45913963)
It’s normal to be "more sensitive" to brightness differences in the peripheral areas compared to the fovea. The fovea has more color receptors, in the other areas, there are comparatively more monochromatic receptors (brightness). The general density of the fovea is also much larger.
Re:Steam Frame by jackwilsdon on Thursday November 13, 2025 @05:31AM (#45913197)
It is doing eye tracking for the foveated rendering - it has 2 cameras inside the visor for it.
Re:Steam Frame by x187463 on Thursday November 13, 2025 @09:29AM (#45915297)
They're referring to the shadertoy linked above. The illusion simulates foveated rendering on your device without eye tracking.
Re:Steam Frame by ghosty141 on Wednesday November 12, 2025 @03:30PM (#45906125)
I'm super curious how they will implement it, if it's a general api in steam vr that headsets like the Bigscreen Beyond could use or if it's more tailored towards the Frame. I hope it's the first as to me it sounds like all you need is eye input and the two streams, the rest could be done by steam-vr.
Re:Steam Frame by modeless on Wednesday November 12, 2025 @02:09PM (#45904626)
Foveated streaming should be much easier to implement than foveated rendering. Just encode two streams, a low res one and a high res one, and move the high res one around.
Re:Steam Frame by rowanG077 on Wednesday November 12, 2025 @01:41PM (#45904077)
There is a LTT video: https://www.youtube.com/watch?v=dU3ru09HTng

Linus says he cannot tell it is actually foveated streaming.

Re:Steam Frame by birdman3131 on Wednesday November 12, 2025 @03:29PM (#45906099)
Thats not what he said. What he said was even rapidly moving his eyes around he could not spot the lower resolution part.
Re:Steam Frame by rowanG077 on Wednesday November 12, 2025 @04:11PM (#45906760)
If you are going to be pedantic then do it right. Because that's also not what said. He said that no matter how fast he moved his eyes he wasn't able to catch it.
Re:Steam Frame by archon810 on Wednesday November 12, 2025 @04:21PM (#45906897)
Re:Steam Frame by stetrain on Wednesday November 12, 2025 @04:25PM (#45906951)
How is that meaningfully different than not being able to tell that it's foveated?
Re:Steam Frame by Night_Thastus on Wednesday November 12, 2025 @01:43PM (#45904104)
I believe in Linus very little. I'll keep my eyes peeled to see what others say. It's certainly possible though, Valve has the chops to pull it off.
Re:Steam Frame by stetrain on Wednesday November 12, 2025 @01:56PM (#45904351)
Norm from Tested said the same in his video.

https://youtu.be/b7q2CS8HDHU

Re:Steam Frame by potatolicious on Wednesday November 12, 2025 @02:21PM (#45904875)
The Verge reports similarly - can't tell foveated streaming. Seems like Valve really cracked the code with this one.
Re:Steam Frame by nabakin on Wednesday November 12, 2025 @04:23PM (#45906930)
I don't think a lot of people realize how big of a deal this is. You used to have to choose between wireless and slow or wired and fast. Now you can have both wireless and fast. It's insane.
Re:Steam Frame by stetrain on Wednesday November 12, 2025 @04:26PM (#45906967)
Yep, that basically guarantees this as a purchase for me. It's basically a Quest 3 with some improvements, an open non-Meta OS, and the various WiFi and Streaming app issues fixed to make it nearly as good as a wired headset.
Re:Steam Frame by nabakin on Wednesday November 12, 2025 @04:29PM (#45907004)
I haven't bought a VR headset since the Oculus Rift CV1, but this might do it for me
Re:Steam Frame by ehnto on Wednesday November 12, 2025 @09:51PM (#45909929)
If you are lucky enough to have wired as an option anyway, especially in linux this has been shaky. But with Steam continuing to push into linux and VR I have no doubt this will change quickly.
Re:Steam Frame by nabakin on Wednesday November 12, 2025 @04:21PM (#45906900)
Also mentions 1-2ms latency on a modern GPU
Re:Steam Frame by ynx on Wednesday November 12, 2025 @05:36PM (#45907846)
If you use a Quest Pro and use Steam Link with a WiFi 6E access point, that should accurately represent the experience of using it.

It's close to imperceptible in normal usage.