News for hackers. Stuff that matters.
Re:FP8 is ~100 tflops faster when the kernel name has "cutla... by tempaway43563 on Friday July 11, 2025 @07:58AM (#44531137)
So, what is Cutlass, can someone explain whether checking for kernel names makes sense here or is a form of cheating?

https://docs.nvidia.com/cutlass/index.html

Re:FP8 is ~100 tflops faster when the kernel name has "cutla... by rurban on Friday July 11, 2025 @08:25AM (#44531340)
That's strange because the cutlass docs explicitly does NOT mention fp8 support. So it looks like it can be used nevertheless with fp8 by using the name hack.
Re:FP8 is ~100 tflops faster when the kernel name has "cutla... by mlazos on Friday July 11, 2025 @08:50AM (#44531545)
It supports e5m2 and e4m3 right in the doc linked.
Re:FP8 is ~100 tflops faster when the kernel name has "cutla... by gpm on Friday July 11, 2025 @08:58AM (#44531611)
Github version: https://github.com/NVIDIA/cutlass

I wonder if we search the comments if we can find something referencing this.