News for hackers. Stuff that matters.

A comment on A Guide to Local Coding Models. Parent comment

Re:A Guide to Local Coding Models by calgoo on Monday December 22, 2025 @05:09AM (#46352812)
Only issue I have found with llama.cpp is trying to get it working with my amd GPU. Ollama almost works out of the box, in docker and directly on my Linux box.
[ Parent | on HN ]
Re:A Guide to Local Coding Models by Lapel2742 on Monday December 22, 2025 @11:14AM (#46355340)
>Only issue I have found with llama.cpp is trying to get it working with my amd GPU.

I had no problems with ROCm 6.x but couldn't get it to run with ROCm 7.x. I switched to Vulkan and the performance seems ok for my use cases

[ Parent | on HN ]