Re:Llama.cpp supports Vulkan. why doesn't Ollama?
by adastra22 on Friday January 31, 2025 @09:27AM
(#42887998)
They can still run a lot more users on the same number of GPUs (and they don't have a lot) using distilled models.
[ Parent
| on HN ]
There are no comments on this comment yet.