News for hackers. Stuff that matters.
Re:AMD's Freshly-Baked MI350: An Interview with the Chief Ar... by ryao on Sunday June 22, 2025 @01:24PM (#44348590)
The higher power requirements of datacenter GPUs are mostly from running hardware well past a reasonable point on the efficiency curve to eke slightly higher generational increases in performance. Nvidia for example has three versions of the RTX PRO 6000. One runs at 600W while the other two run at 300W. The main differences are the power target and the cooling solutions. If I recall correctly, the performance difference between them is less than 20%, despite a 50% reduction in power consumption, for what is effectively the same hardware. This can be confirmed by changing the power target of the 600W version to 300W and benchmarking the before and after. Plenty of people have made similar observations of AMD’s hardware.

That said, I am confident that Nvidia will continue serve those of us who want our own hardware.

Re:AMD's Freshly-Baked MI350: An Interview with the Chief Ar... by latchkey on Sunday June 22, 2025 @04:06PM (#44349862)
They all bin their chips after testing. 355x is 35% faster than 300x and uses almost 2x more power.

But 355 has fp4/6 added in, which until udma comes out, likely won’t get emulated.

It is fine if you dont need the features of newer hardware, but if you do… then desktop won’t help you.

Re:AMD's Freshly-Baked MI350: An Interview with the Chief Ar... by ryao on Sunday June 22, 2025 @07:21PM (#44351108)
Your comment does not make much sense to me. The 355x and 300x are two different chips, not binned versions of one another. The RTX PRO 6000 has fp4/fp6 support too, so there is no need to use datacenter exclusive hardware to get that.
Re:AMD's Freshly-Baked MI350: An Interview with the Chief Ar... by latchkey on Sunday June 22, 2025 @09:18PM (#44351681)
I wasn’t referring to them being binned to each other. Oh nice, I didn’t know that about the 6k.
Re:AMD's Freshly-Baked MI350: An Interview with the Chief Ar... by ryao on Sunday June 22, 2025 @11:48PM (#44352305)
The consumer 50 series GPUs also have FP4/FP6 support. Nvidia talks about it a little here:

https://images.nvidia.com/aem-dam/Solutions/geforce/blackwel...

FP4 is given a full page advertising it while FP6 support in “RTX Blackwell” is a footnote.