News for hackers. Stuff that matters.
Re:Ollama now supports AMD graphics cards by UncleEntity on Saturday March 16, 2024 @07:00PM (#39730223)
I was trying to get AMD GPU support going in llama.cpp a couple weeks ago and just gave up after a while. 'rocminfo' shows that I have a GPU and, presumably, rocm installed but there were build problems I didn't feel like sorting out just to play with a LLM for a bit.

Kudos if Ollama has this sorted out.

There are no comments on this comment yet.