News for hackers. Stuff that matters.
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by adastra22 on Friday January 31, 2025 @09:27AM (#42887998)
They can still run a lot more users on the same number of GPUs (and they don't have a lot) using distilled models.

There are no comments on this comment yet.