Re:Run CUDA, unmodified, on AMD GPUs
by saagarjha on Wednesday July 17, 2024 @03:53AM
(#40983468)
Yes. Take a look at, say, CUTLASS: you'll see that they use PTX instructions because there are no intrinsics, much less automatic compiler lowering, for the accelerators they target.
[ Parent
| on HN ]
Re:Run CUDA, unmodified, on AMD GPUs
by HarHarVeryFunny on Wednesday July 17, 2024 @09:26AM
(#40985689)
Yes, but that's an NVIDIA project, so would be expected to be hand optimized, same as their cuDNN kernels.
I'm more curious about what types of model people in research or industry are developing, where NVIDIA support such as this is not enough, and they are developing their own PTX kernels.