News for hackers. Stuff that matters.
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by n144q on Friday January 31, 2025 @07:17AM (#42886904)
https://github.com/ggerganov/llama.cpp/discussions/9565

Discussions under https://news.ycombinator.com/item?id=40693391

(I recommend doing a search yourself first)

Basically, if you know how to use a computer, you can use Ollama (almost). You can't say the same thing about llama.cpp. Not everyone knows how to build from source, or even what "build" means.

There are no comments on this comment yet.