News for hackers. Stuff that matters.
Re:Llama.cpp: Full CUDA GPU Acceleration by superkuh on Tuesday June 13, 2023 @03:20PM (#36315498)
That's exactly it. Who wants to try pulling in an entire language with wide depenencies and it's ecosystem of envs/containers/etc when a single program will do it? Not people who just want to run inference on pre-made models.

There are no comments on this comment yet.