Re:Llama.cpp: Full CUDA GPU Acceleration
by superkuh on Tuesday June 13, 2023 @03:20PM
(#36315498)
That's exactly it. Who wants to try pulling in an entire language with wide depenencies and it's ecosystem of envs/containers/etc when a single program will do it? Not people who just want to run inference on pre-made models.
[ Parent
| on HN ]
There are no comments on this comment yet.