News for hackers. Stuff that matters.
Re:Ollama now supports AMD graphics cards by cjbprime on Saturday March 16, 2024 @12:25AM (#39723376)
This will likely build a version without GPU acceleration, I think?
Re:Ollama now supports AMD graphics cards by jameshart on Saturday March 16, 2024 @11:05AM (#39726555)
Builds with Metal support on my Mac M2
Re:Ollama now supports AMD graphics cards by UncleEntity on Saturday March 16, 2024 @07:00PM (#39730223)
I was trying to get AMD GPU support going in llama.cpp a couple weeks ago and just gave up after a while. 'rocminfo' shows that I have a GPU and, presumably, rocm installed but there were build problems I didn't feel like sorting out just to play with a LLM for a bit.

Kudos if Ollama has this sorted out.