Re:FP8 is ~100 tflops faster when the kernel name has "cutla...
by rurban on Friday July 11, 2025 @08:25AM
(#44531340)
That's strange because the cutlass docs explicitly does NOT mention fp8 support. So it looks like it can be used nevertheless with fp8 by using the name hack.
Re:FP8 is ~100 tflops faster when the kernel name has "cutla...
by mlazos on Friday July 11, 2025 @08:50AM
(#44531545)
It supports e5m2 and e4m3 right in the doc linked.
Re:FP8 is ~100 tflops faster when the kernel name has "cutla...
by gpm on Friday July 11, 2025 @08:58AM
(#44531611)
Github version: https://github.com/NVIDIA/cutlass
I wonder if we search the comments if we can find something referencing this.
https://docs.nvidia.com/cutlass/index.html