News for hackers. Stuff that matters.
Re:Making AMD GPUs competitive for LLM inference by 0xDEADFED5 on Tuesday December 24, 2024 @08:46PM (#42506280)
Big agree on Intel working on SYCL. I've millions of tasks thru SYCL llama.cpp at this point, and though SYCL reliably does 5-6x the prompt processing speed of the Vulkan builds, current Vulkan builds are now up to 50% faster at token generation than SYCL on my Intel GPU

There are no comments on this comment yet.