News for hackers. Stuff that matters.
Re:Forget ChatGPT: why researchers now run small AIs on thei... by wkat4242 on Saturday September 21, 2024 @02:49PM (#41611854)
Not really. I run ollama on an AMD Radeon Pro and it works great.

For tooling to train models it's a bit more difficult but inference works great on AMD.

My CPU is an AMD Ryzen and the OS Linux. No problem.

I use OpenWebUI as frontend and it's great. I use it for everything that people use GPT for.

There are no comments on this comment yet.