News for hackers. Stuff that matters.
Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by dtx1 on Saturday June 10, 2023 @03:39PM (#36274259)
Measured as one percent lows and again, most GPUs under most Conditions simply don't saturate PCIe enough for that to make a difference. Der8auer and GamersNexus on youtube have plenty of examples.
Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by Retric on Saturday June 10, 2023 @03:48PM (#36274353)
1% lows in a given benchmark isn’t really measuring stutter in practice, what you want is percentage of frames that don’t finish in time.

If once a minute you miss 4 frames in a row that’s noticeable even if everything else is rock solid. The thing is people adjust their resolution/settings to reach acceptable FPS, thus it’s fairly GPU independent. What matters is rendering volatility as assets are loaded etc.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by sudosysgen on Saturday June 10, 2023 @05:27PM (#36275303)
That metric is irrelevant now that we have adaptive refresh rates. You don't really "miss" a frame anymore. 1% low is now the correct metric.
Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by Retric on Saturday June 10, 2023 @07:26PM (#36276381)
If the pipeline stalls for 70ms it’s a problem even if in theory you don’t “miss” a frame you still aren’t getting new frames until rendering finishes.

All adaptive refresh rates do is avoiding unwanted delays after the frame finishes.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by sudosysgen on Saturday June 10, 2023 @08:49PM (#36276897)
That's not how it works. A 70ms pipeline stall means a ~90ms frame which means that your 1% framerate low is going to be reduced.

Adaptive refresh rate means that only frame rate matters. You can't miss a frame, you can only have a frame take longer, and that's measured perfectly well by 1% or 0.1% low frame rates.

Also I don't see why an M series CPU is going to be any better at feeding the (asynchrous, multiple frames in flight) GPU rendering pipeline than a modern x86 CPU, when both are just as fast. macOS is also pretty bad at realtime scheduling for heavy workloads compared to modern Linux and Windows.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by Retric on Saturday June 10, 2023 @10:35PM (#36277420)
Yes occasional 90ms stall reduces 1% frame rates, but less than how annoying it is.

A 10 minute test at 120 FPS is 10 * 60 * 120 ~= 72,000 frames. Your 1% lows is an average of ~720 frames but so what if of 300 them are at 60 FPS you’re going to have trouble noticing.

While if you’re almost rock solid at 120FPS a dozen 90ms stalls it’s really obvious that something is wrong but the calculated 1% low’s actually look better.

The comparison isn’t average FPS or even 1% lows where dedicated graphics cars have an advantage, the comparison is what happens when things go very wrong. And it’s in that very specific case when they may have an advantage.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by wtallis on Saturday June 10, 2023 @11:18PM (#36277664)
> While if you’re almost rock solid at 120FPS a dozen 70ms stalls it’s really obvious that something is wrong but the calculated 1% low’s may actually look better.

I think this is an instance of the coordinated omission problem: you cannot simply measure the latency of the frames that were completed, but instead have to consider the frames that should have been delivered during a stall. Looking at frame time percentiles means a stall only penalizes your metric with one bad frame, when it should be penalized for missing several frames and showing the user an increasingly stale image for several average-frametimes.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by sudosysgen on Sunday June 11, 2023 @12:13AM (#36277941)
This isn't actually true. Looking at aveeages will in fact reflect correctly on average frame staleness over a sampling period. A single frame that's 5x too long or 4 frames that are 2x too long have the same impact on the average delta of frame staleness on the total sum.

Think of it like Little's law in queing theory , it's better to simply just look at different percentiles, like 99 or 99.9th. The average framerate correctly indicates the average staleness.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by wtallis on Sunday June 11, 2023 @12:45AM (#36278149)
> A single frame that's 5x too long or 4 frames that are 2x too long have the same impact on the average delta of frame staleness on the total sum.

It's not clear to me: are you saying those two scenarios should be quantified as equally bad? Because it seems pretty obvious to me that the 5x outlier is qualitatively much worse.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by sudosysgen on Sunday June 11, 2023 @12:53AM (#36278209)
The fact that the 5x outlier may be qualitatively worse is something that you pin down using percentiles, which is what everyone does, either 1% or 0.1% low. The argument about time-weighted frame staleness is not mathematically valid.
Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by Retric on Sunday June 11, 2023 @12:58AM (#36278239)
There’s nothing inherently mathematically special about 1% or 0.1%, you can also use 0.0042% or 0.00069% which highlights this kind of extreme outliers more.

Benchmarking sites use 1% or 0.1% because they better highlight the commodity PC hardware rather than the games bugs and architecture.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by sudosysgen on Sunday June 11, 2023 @09:54AM (#36281378)
That's not true. You can't use 0.0042% because then you don't have enough frames to be statistically significant without running for a very long time. It's also true that a frame pacing issue that is so rare that it isn't even impacting the 0.1% frame time isn't going to be noticeable, really.

These benchmarks are controlled for game bugs and architecture by simply averaging over ~40-50 games, on repeatable loops.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by sudosysgen on Sunday June 11, 2023 @12:08AM (#36277916)
This is a completely misguided analysis. First of all, there is nothing in the M series architecture that's going to avoid pipeline stalls, let aloe huge 70ms graphics pipeline stalls. As I've explained above, games keep multiple frame pipelines in flight at once, so you don't have these kind of issues unless there is a scheduling or I/O issue. There is no advantage here.

The only advantage is that the transfer from GPU to CPU is faster in terms of latency. This doesn't cause pipeline stalls, because as I've explained above, frames are kept in flight, so latency is not critical. At the same time, modern CPU-GPU interconnects have similar bandwidth to RAM.

Additionally, you're not the first person to have thought about frame pacing. Dozens of reviewers have full frame pacing graphs with the frame times of every frame, as well as 0.1% lows, and we simply don't see what you're describing. 100ms+ frames are not a problem on modern games and modern hardware, and when they are, it's because of some blocking read to storage or to some scheduling issue, not because of CPU/GPU speed.

The impact of link speed on 0.1% low framerates has already been investigated, and it's minimal, and there isn't even an advantage here.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by Retric on Sunday June 11, 2023 @12:23AM (#36277997)
> 100ms+ frames are not a problem on modern games and modern hardware, and when they are

So, you actually acknowledge that this stuff happens and 1% lows doesn’t track them properly. I can only assume you’re arguing in bad faith at this point.

There’s many causes of this stuff beyond disk IO which I can give examples for but I don’t want to get into it.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by Retric on Sunday June 11, 2023 @12:56AM (#36278225)
> 100ms+ frames are not a problem on modern games and modern hardware, and when they are

There’s a multitude of such bugs which ship with modern titles. Benchmarking sites don’t use the release day build of 2077 for very good reasons.

Re:Apple M2 Ultra Isn't Faster Than Last Gen AMD&Intel Deskt... by sudosysgen on Sunday June 11, 2023 @09:54AM (#36281390)
That's a problem with release day video games being unfinished buggy messes, not something that's going to change with hardware.