News for hackers. Stuff that matters.

A comment on Llama.cpp supports Vulkan. why doesn't Ollama?. Parent comment

Re:Llama.cpp supports Vulkan. why doesn't Ollama? by a12k on Friday January 31, 2025 @07:48AM (#42887140)
It severely over-permissions itself on my Mac.
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by super_mario on Friday January 31, 2025 @08:35AM (#42887482)
Can you please elaborate? How are you running ollama? I just build it from source and have written a shell script to start/stop it. It runs under my local user account (I should probably have its own user) and is of course not exposed outside localhost.
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by celeritascelery on Friday January 31, 2025 @09:07AM (#42887806)
I have never had it request any permissions
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by andreasmetsala on Friday January 31, 2025 @10:30AM (#42888634)
Just install it from Brew and run the service in a separate terminal tab.
[ Parent | on HN ]