News for hackers. Stuff that matters.
Re:Ollama now supports AMD graphics cards by reustle on Friday March 15, 2024 @04:21PM (#39720281)
Even for just running a model locally, Ollama provided a much simpler "one click install" earlier than most tools. That in itself is worth the support.
Re:Ollama now supports AMD graphics cards by Aka456 on Friday March 15, 2024 @06:46PM (#39721468)
Koboldcpp is also very, very good, plug and play, very complet web UI, nice little api with sse text streaming, vulkan accelerated, have an AMD fork...