Re:FP8 is ~100 tflops faster when the kernel name has "cutla...
by saagarjha on Friday July 11, 2025 @07:34AM
(#44530967)
It's like 5-10% here
[ Parent
| on HN ]
Re:FP8 is ~100 tflops faster when the kernel name has "cutla...
by irrelative on Friday July 11, 2025 @11:07AM
(#44532999)
Correct, this is the actual headline too. 100 tflops sure seems like it'd be more than that, but here we are.
If the headline was "FB8 is ~7% faster when kernel name has 'cutlass' in it...", it wouldn't seem sensational.
Re:FP8 is ~100 tflops faster when the kernel name has "cutla...
by saagarjha on Friday July 11, 2025 @04:02PM
(#44536305)
I think the interesting part is that it improves performance measurably at all, not the actual number. These people are trying to hit 90+% MFU (though most don't reach it) so this does actually translate to many millions of dollars for them.