News for hackers. Stuff that matters.
Re:Run CUDA, unmodified, on AMD GPUs by HarHarVeryFunny on Tuesday July 16, 2024 @10:58AM (#40977230)
How much performance difference is there between writing a kernel in a high level language/framework like PyTorch (torch.compile) or Triton, and hand optimizing? Are you writing kernels in PTX?

What's your opinion on the future of writing optimized GPU code/kernels - how long before compilers are as good or better than (most) humans writing hand-optimized PTX?

Re:Run CUDA, unmodified, on AMD GPUs by throwaway81523 on Tuesday July 16, 2024 @04:54PM (#40980251)
The CUDA version of LCZero was around 2x or 3x faster than the Tensorflow(?) version iirc.