Llama.cpp supports Vulkan. why doesn't Ollama?

Re:Llama.cpp supports Vulkan. why doesn't Ollama? by krowek on Friday January 31, 2025 @08:54AM (#42887659)

> But why run it in a VM?

Because you don't execute untrusted code in your machine without containerization/virtualization. Don't you?

[ Parent | on HN ]

Re:Llama.cpp supports Vulkan. why doesn't Ollama? by adastra22 on Friday January 31, 2025 @08:56AM (#42887684)

Every single day. There's just too much good software out there, and life is too short to be so paranoid.

[ Parent | on HN ]

Re:Llama.cpp supports Vulkan. why doesn't Ollama? by Aurornis on Friday January 31, 2025 @09:05AM (#42887785)

The question was asking why it’s untrusted code, not why you run untrusted code in a VM.

There are a lot of open-source tools that we have to trust to get anything done on a daily basis.

[ Parent | on HN ]