News for hackers. Stuff that matters.

A comment on Llama.cpp: Full CUDA GPU Acceleration. Parent comment

Re:Llama.cpp: Full CUDA GPU Acceleration by mschuetz on Tuesday June 13, 2023 @07:51AM (#36308869)
> It's an official Khronos standard

I think that's the problem. Khronos isn't known for good UX, and being from Khronos is exactly the reason why I'm not even bothering to check it out. I want an alternative to CUDA, but I also want it to be as easy to use as CUDA.

[ Parent | on HN ]
Re:Llama.cpp: Full CUDA GPU Acceleration by LoganDark on Tuesday June 13, 2023 @07:56AM (#36308926)
Being from Khronos is also a reason why it might actually be usable in a decade's time, like Vulkan.

(Vulkan is from 2015 and is just recently starting to become usable.)

[ Parent | on HN ]
Re:Llama.cpp: Full CUDA GPU Acceleration by sicariusnoctis on Saturday June 17, 2023 @02:05AM (#36367724)
From a non-expert's standpoint, Vulkan feels quite unusable and complex.
[ Parent | on HN ]
Re:Llama.cpp: Full CUDA GPU Acceleration by mschuetz on Tuesday June 20, 2023 @05:51AM (#36401764)
From an expert's standpoint, it's still quite unusable and complex.
[ Parent | on HN ]