News for hackers. Stuff that matters.
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by imtringued on Friday January 31, 2025 @10:07AM (#42888381)
Ollama doesn't really need competition. Llama.cpp just needs a few usability updates to the gguf format so that you can specify a hugging face repository like you can do in vLLM already.

There are no comments on this comment yet.