Re:Zen, CUDA, and Tensor Cores, Part I: The Silicon
by leogao on Saturday September 07, 2024 @12:19PM
(#41474710)
In domains like ML, people care way more about the half precision FLOPs than single precision.
[ Parent
| on HN ]
Re:Zen, CUDA, and Tensor Cores, Part I: The Silicon
by bee_rider on Saturday September 07, 2024 @02:22PM
(#41475453)
They don’t have much application outside ML, at least as far as I know. Just call them ML ops, and then they can include things like those funky shared exponent floating point formats, and or stuff with ints.
Or they could be measured in bits per second.
Actually I’m pretty interested in figuring out if we can use them for numerical linear algebra stuff, but I think it’d take some doing.