Re:Ollama is now available on Windows in preview
by FirmwareBurner on Saturday February 17, 2024 @06:08PM
(#39414423)
What about AMD APUs with RDNA graphics? ANy chance of getting Olama for them?
Re:Ollama is now available on Windows in preview
by spookie on Saturday February 17, 2024 @08:15PM
(#39415173)
I suppose it comes down to ROCm support.
https://docs.amd.com/en/docs-5.7.1/release/windows_support.h...
A few of the maintainers of the project are from the Toronto area, the original home of ATI technologies [1], and so we personally want to see Ollama work well on AMD GPUs :).
One of the test machines we use to work on AMD support for Ollama is running a Radeon RX 7900XT, and it's quite fast. Definitely comparable to a high-end GeForce 40 series GPU.
[1]: https://en.wikipedia.org/wiki/ATI_Technologies