News for hackers. Stuff that matters.

A comment on Llama.cpp supports Vulkan. why doesn't Ollama?. Parent comment

Re:Llama.cpp supports Vulkan. why doesn't Ollama? by zophiana on Friday January 31, 2025 @07:25AM (#42886963)
Honestly I just didn't know it was this easy to use, maybe because of the name... But ramalama seems to be a full replacement for ollama
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by himhckr on Friday January 31, 2025 @08:12AM (#42887312)
ramalama still needs users to be able to install docker first, no? That’s a barrier to entry for many users esp. Windows where I have had my struggles running Docker not to mention a massive resource hog.
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by sroecker on Friday January 31, 2025 @09:49AM (#42888209)
Yes, but ramalama defaults to podman. Podman Desktop is very easy to install and use.
[ Parent | on HN ]