Ollama now supports AMD graphics cards

Re:Ollama now supports AMD graphics cards by kodarna on Friday March 15, 2024 @02:58PM (#39719407)

I wonder why they aren't supporting RX 6750 XT and lower yet, are there architectural differences between these and RX 6800+?

[ Parent | on HN ]

Re:Ollama now supports AMD graphics cards by slavik81 on Friday March 15, 2024 @03:11PM (#39719578)

Those are Navi 22/23/24 GPUs while the RX 6800+ GPUs are Navi 21. They have different ISAs... however, the ISAs are identical in all but name.

LLVM has recently introduced a unified ISA for all RDNA 2 GPUs (gfx10.3-generic), so the need for the environment variable workaround mentioned in the other comment should eventually disappear.

[ Parent | on HN ]

Re:Ollama now supports AMD graphics cards by Zambyte on Friday March 15, 2024 @03:03PM (#39719475)

They don't support it, but it works if you set an environment variable.

https://github.com/ollama/ollama/issues/2870#issuecomment-19...

[ Parent | on HN ]