News for hackers. Stuff that matters.
Re:Llama.cpp: Full CUDA GPU Acceleration by bottled_poe on Tuesday June 13, 2023 @01:00AM (#36305599)
I agree, though it’s still vendor lock-in. I think a lot of devs aren’t aware of how tightly integrated these frameworks are with the hardware. It’s not trivial to separate the two and the companies driving this tech have no motive to do so, while also being amongst a very small number of hardware designers.

There are no comments on this comment yet.