News for hackers. Stuff that matters.
Re:Ollama is now available on Windows in preview by jmorgan on Saturday February 17, 2024 @04:29PM (#39413715)
AMD GPU support is definitely an important part of the project roadmap (sorry this isn't better published in a ROADMAP.md or similar for the project – will do that soon).

A few of the maintainers of the project are from the Toronto area, the original home of ATI technologies [1], and so we personally want to see Ollama work well on AMD GPUs :).

One of the test machines we use to work on AMD support for Ollama is running a Radeon RX 7900XT, and it's quite fast. Definitely comparable to a high-end GeForce 40 series GPU.

[1]: https://en.wikipedia.org/wiki/ATI_Technologies

Re:Ollama is now available on Windows in preview by FirmwareBurner on Saturday February 17, 2024 @06:08PM (#39414423)
What about AMD APUs with RDNA graphics? ANy chance of getting Olama for them?
Re:Ollama is now available on Windows in preview by spookie on Saturday February 17, 2024 @08:15PM (#39415173)