News for hackers. Stuff that matters.

A comment on Llama.cpp supports Vulkan. why doesn't Ollama?. Parent comment

Re:Llama.cpp supports Vulkan. why doesn't Ollama? by kgwgk on Friday January 31, 2025 @09:04AM (#42887779)
> I can `brew install ollama`.

Can you `brew install llama.cpp`?

[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by fkyoureadthedoc on Friday January 31, 2025 @09:14AM (#42887890)
probably, but why would I at this point? it's not on aider's supported list. If I needed to replace ollama for some reason I'd probably go with lms.
[ Parent | on HN ]