News for hackers. Stuff that matters.

A comment on ROCm Device Support Wishlist. Parent comment

Re:ROCm Device Support Wishlist by cokecan on Tuesday January 21, 2025 @01:43AM (#42777252)
Super annoying. I have an RX 6600 XT and can't get ROCm to work on Linux. Vulkan ML however worked perfectly out of the box, so at least I got something.

Just weird the official thing doesn't work.

[ Parent | on HN ]
Re:ROCm Device Support Wishlist by suprjami on Tuesday January 21, 2025 @07:17AM (#42779288)
Use the Debian libraries, it works:

https://github.com/superjamie/rocswap

[ Parent | on HN ]
Re:ROCm Device Support Wishlist by slavik81 on Tuesday January 21, 2025 @08:04AM (#42779655)
The caveat being that PyTorch has a lot of dependencies and a couple of them are not yet available in Debian Unstable. For folks wanting to use StableDiffusion, that's a problem. However, the available packages are more than sufficient for llama-cpp as you point out.
[ Parent | on HN ]