News for hackers. Stuff that matters.

A comment on Llama.cpp supports Vulkan. why doesn't Ollama?. Parent comment

Re:Llama.cpp supports Vulkan. why doesn't Ollama? by nialv7 on Friday January 31, 2025 @07:33AM (#42887028)
It's fully open source. I mean yes it uses llama.cpp without giving it credit. But why run it in a VM?
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by a12k on Friday January 31, 2025 @07:48AM (#42887140)
It severely over-permissions itself on my Mac.
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by super_mario on Friday January 31, 2025 @08:35AM (#42887482)
Can you please elaborate? How are you running ollama? I just build it from source and have written a shell script to start/stop it. It runs under my local user account (I should probably have its own user) and is of course not exposed outside localhost.
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by celeritascelery on Friday January 31, 2025 @09:07AM (#42887806)
I have never had it request any permissions
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by andreasmetsala on Friday January 31, 2025 @10:30AM (#42888634)
Just install it from Brew and run the service in a separate terminal tab.
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by instagary on Friday January 31, 2025 @08:27AM (#42887417)
Isn't there a clause in MIT that says you're required to give credit? Also, I didn't know a YC company which started it: https://www.ycombinator.com/companies/ollama.
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by aduffy on Friday January 31, 2025 @09:04AM (#42887774)
The project existed in the open source and then subsequently the creators sought funding to work on it full time.
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by instagary on Friday January 31, 2025 @09:08AM (#42887810)
Makes sense!
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by krowek on Friday January 31, 2025 @08:54AM (#42887659)
> But why run it in a VM?

Because you don't execute untrusted code in your machine without containerization/virtualization. Don't you?

[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by adastra22 on Friday January 31, 2025 @08:56AM (#42887684)
Every single day. There's just too much good software out there, and life is too short to be so paranoid.
[ Parent | on HN ]
Re:Llama.cpp supports Vulkan. why doesn't Ollama? by Aurornis on Friday January 31, 2025 @09:05AM (#42887785)
The question was asking why it’s untrusted code, not why you run untrusted code in a VM.

There are a lot of open-source tools that we have to trust to get anything done on a daily basis.

[ Parent | on HN ]