News for hackers. Stuff that matters.
Re:AMD CPU Use Among Linux Gamers Approaching 70% Marketshare by BLKNSLVR on Sunday July 02, 2023 @11:27PM (#36568392)
I think Arubis didn't push the point hard enough. Nvidia is a long way ahead of AMD in AI/ML hardware capability, from my very limited experience.

I got a Stable Diffusion thing up and running locally on a relatively old AMD RX 580 with 8GB of memory, and default settings of 512x512 with 10 (I think) passes, and it takes about 10 minutes to generate an image. On a similarly aged Nvidia 1060 with 6GB of memory that a colleague of mine uses for their local Stable Diffusion instance, it takes about 20 seconds to generate an image.

I don't know how apples and oranges this comparison is, my OS is Linux and his is Windows, for example, but 10 minutes versus 20 seconds is, for me, a massively disappointing difference.

I'm sure the gap has decreased in the intervening 6-7 years, but I don't know how much - such that I'd be opting for a second hand Nvidia over a new AMD (and I philosophically prefer AMD).

This may be a worthwhile read if you're looking to squeeze the most performance: https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni...

Re:AMD CPU Use Among Linux Gamers Approaching 70% Marketshare by Aeolun on Monday July 03, 2023 @01:27AM (#36569234)
That doesn’t seem like a difference caused by the chip, but by whatever integration is used.
Re:AMD CPU Use Among Linux Gamers Approaching 70% Marketshare by nicopappl on Monday July 03, 2023 @02:21AM (#36569494)
To clarify this. On my RX5700 XT, with ROCm, Stable Diffusion generates images on the default sampler at 512x512 20 passes in about 2 seconds. It's definitively slower than a similar NVIDIA card, but I've no concrete numbers.

It's still a pain in other ways. AMD does not support ROCm on consumer-grade GPUs, it only "happens to work". I had to explicitly install the 3.10 python interpreter and use an older torch version, because seemingly, the newer ROCm releases do not support the RX5700 XT. Also ROCm only works on Linux.