Re:Llama.cpp supports Vulkan. why doesn't Ollama?
by imtringued on Friday January 31, 2025 @10:07AM
(#42888381)
Ollama doesn't really need competition. Llama.cpp just needs a few usability updates to the gguf format so that you can specify a hugging face repository like you can do in vLLM already.
[ Parent
| on HN ]
There are no comments on this comment yet.