Re:How to Optimize a CUDA Matmul Kernel for CuBLAS-Like Perf...
by imtringued on Friday July 26, 2024 @02:05PM
(#41080803)
The problem with AMD isn't that they are only hitting 90% of the hardware capabilities vs Nvidia hitting 98%.
It's the fact that AMD doesn't prioritize the reliability of its hardware and software stack. If I run llama.cpp on Vulkan I get a reasonable speedup, but if I raise the batch size to 512, the GPU is starting to make strange noises and shuts the PC down midway. Very cool. 98% of zero is still zero.
It's the fact that AMD doesn't prioritize the reliability of its hardware and software stack. If I run llama.cpp on Vulkan I get a reasonable speedup, but if I raise the batch size to 512, the GPU is starting to make strange noises and shuts the PC down midway. Very cool. 98% of zero is still zero.