News for hackers. Stuff that matters.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by EtienneK on Sunday August 20, 2023 @01:29AM (#37196383)
This is not true at all. AMD GPUs have been constantly delivering better bang-for-buck for a while now.

Edit: of course I am talking about gaming here since you mentioned consoles

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by Iulioh on Sunday August 20, 2023 @02:10AM (#37196615)
Eh.

For me the problem is technology and not raw performance

DLSS and RT are massive for someone with a 4k screen but now 4k gaming hardware outside league of legends lol

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by esperent on Sunday August 20, 2023 @02:21AM (#37196670)
DLSS is only marginally better then FSR 2.0.

Sure, you can see the difference if you're carefully looking for it in comparison videos. But when you're actually playing it's usually not noticeable to any meaningful degree. You're gonna get occasional artefacts with both.

As for ray tracing - to be honest, playing at 4k with an RTX 3070 there's very few games where I can turn it on without the game running unacceptably slow even with DLSS.

Ray traced shadows and AO are nice but hardly a deal breaker.

I think it's more the desire to have the latest and greatest tech that makes Nvidia cards desirable, rather than any material difference that you'll actually notice while gaming.

Some good comparison shots of DLSS 2 and FSR 2 in this video.

https://youtu.be/1WM_w7TBbj0

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by izacus on Sunday August 20, 2023 @03:56AM (#37197070)
I mean, you talk about "comparison videos", when in reality the issue is that significant amount of games support DLSS and pretty much noone supports FSR 2.0.

You can do any comparison you want, but it won't help you when your software won't make use of the library your GPU supports.

(Also, we're at DLSS 3.0 now with frame generation which moves the bar higher.)

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by ekianjo on Sunday August 20, 2023 @04:08AM (#37197136)
Fsr 2 is supported out of tje box on Gamescope in Linux for all games
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by grey8 on Sunday August 20, 2023 @04:25AM (#37197201)
That's not FSR2, that's FSR1.

FSR2 needs game specific integration (IIRC because it needs access to motion vectors) and cannot be applied globally.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by izacus on Sunday August 20, 2023 @05:04AM (#37197388)
Nope, that's FSR 1.0 which looks terrible by any standard.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by ekianjo on Sunday August 20, 2023 @11:02AM (#37199835)
Thanks for the correction
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by BoorishBears on Sunday August 20, 2023 @04:18AM (#37197180)
Hardware Unboxed's viewership draw is placating "Team Red", or the the people who treat hardware like a sports competition, so when they say:

- the overwhelming conclusion is DLSS is the superior upscaling technology with near universally better results

- it was a brutal result for AMD

- DLSS gives NVIDIA a clear selling point

I'm not sure if it backs your suggestion...

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by zirgs on Sunday August 20, 2023 @04:32AM (#37197225)
Seems like it's still better to buy Nvidia then. Nvidia cards support both DLSS and FSR so you can choose the tech that works best with the particular game.

Meanwhile AMD only supports FSR and if the game looks better with DLSS then there's nothing you can do.

AMD cards also aren't that much cheaper so it doesn't make much sense to buy worse tech that you'll be using for years every day to save a few euros.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by grujicd on Sunday August 20, 2023 @05:13AM (#37197443)
It's not as if Nvidia is always a better choice. Things turned around a bit when new crop of games (The Last of Us, Hogwarts Legacy, etc) came out, requiring more than 8GB of VRAM. They do work with 8GB, but with lot more stutterging as textures have to be constantly transfered from main RAM. For these games amount of VRAM made a huge difference. At that point in time, AMD had more mid level cards with 12GB (6700) and 16GB (6800) and for considerably less money than equivalent Nvidia, at least in Europe. Nvidia cheapened and stuck to 8GB even for 3070 which was more expensive than 16GB 6080 around here.. This became a big issue and pushed Nvidia to put more VRAM in next generation.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by BoorishBears on Sunday August 20, 2023 @08:59AM (#37198696)
If you actually try and find proof of the 8GB fiasco, there's mostly one source that put together an artificial scenario where they pushed a bottom end card to 4k on newly launched console ports which then got optimized.

NVIDIA said as much, released a 16GB version, and lo-and-behold it's absolutely pointless, even performing worse than the 8GB at times: https://www.tomshardware.com/reviews/nvidia-geforce-rtx-4060...

Most graphics cards are still under 8GB of VRAM, and raw numbers of memory storage mean nothing for performance in isolation.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by ChoGGi on Sunday August 20, 2023 @11:46AM (#37200243)
I believe it's the 128-bit interface hindering performance more than the amount of VRAM.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by olaulaja on Sunday August 20, 2023 @05:31AM (#37197554)
The framing here is a little unfair, its DLSS that does not support AMD hardware, not the other way around. This is clearly a deliberate decision by Nvidia. Meanwhile AMD/FSR supports both AMD and Nvidia hardware.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by BoorishBears on Sunday August 20, 2023 @09:12AM (#37198797)
The framing is fair unless you expect NVIDIA to ditch their ML based solution for a class of inferior implementations which in turn can run just about anywhere.

DLSS isn't "NVIDIA flavored FSR", it's a more advanced pipeline that requires significantly more architectural alignment. FSR 3 was going to be the closest thing to an equivalent and won't run everywhere FSR 2 does.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by NBJack on Sunday August 20, 2023 @05:23PM (#37203038)
DLSS directly leverages the tensor cores of particular NVidia cards.

Whether or not this is just a marketing gimmick is up to you and your own conclusions on the matter, but AMD doesn't seem to have an equivalent hardware tech for this yet. It seems to be taking steps in the right direction with the WMMA instruction for accelerating matrix multiplication in a similar fashion, but performance so far head-to-head seems lacking, and I haven't seen anything definitive out of AMD suggesting this for gaming purposes.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by NBJack on Sunday August 20, 2023 @05:11PM (#37202969)
Have you tried DLSS 3 with frame generation yet? Ray tracing performance hits are mitigated substantially, 4K included. What is more shocking to me is how low they got the latency on it; I have yet to notice perceptible lag when turned on (contrasting this of course with TVs that attempt to increase frames to achieve the 'soap opera effect', where lag becomes substantial). I just hope more games support it one day.

FSR may one day get much better, but in my personal preferences and tastes, I greatly prefer DLSS for upscaling. It tends to be sharper, better at fine details at long distances, and tends to do better with certain (literal) edge cases.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by esperent on Sunday August 20, 2023 @09:39PM (#37204583)
[delayed]
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by hugh4life on Monday August 21, 2023 @06:42PM (#37216331)
Weird you didn't post the comparison he made a couple weeks later where he says that sometimes DLSS beats native rendering: https://www.youtube.com/watch?v=O5B_dqi_Syc
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by PeterStuer on Sunday August 20, 2023 @02:23AM (#37196681)
For mid-tier gaming they are very competitive, but for consumer AI they were not even a player until very recently and still marginal at best.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by mjan22640 on Sunday August 20, 2023 @03:12AM (#37196916)
What is the root cause of AMD not being good for AI?
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by arcanemachiner on Sunday August 20, 2023 @03:18AM (#37196937)
“Nvidia's SDK, CUDA, is the industry standard and they have built a huge range of tools on top of that for training large models, inference-serving, optimization, transfer learning, infrastructure management and operations automation, and a lot of vertical-specific applications.”

https://www.google.com/search?q=why%20is%20nvidia%20better%2...

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by mjan22640 on Sunday August 20, 2023 @03:52AM (#37197058)
So its not the hw, but an API issue? Is it not possible to port the tools to the AMD API? Or does the AMD API not allow to properly utilize the compute power of the hw?
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by mananaysiempre on Sunday August 20, 2023 @04:41AM (#37197274)
CUDA is proprietary to Nvidia, and it’s unlikely they would ever allow implementing it on other vendors’ hardware. DirectML mentioned here is proprietary to Microsoft but at least hardware-neutral. It is also much less popular. OpenCL is open but receives hardly any usage at all, unfortunately.

(To be fair, Nvidia were at the forefront of this GPGPU thing since before there were dedicated APIs for it, so they certainly deserve some credit, but at this point they seem in desperate need for someone to finally knock them down.)

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by dagw on Sunday August 20, 2023 @04:33AM (#37197233)
AMDs APIs have historically been way behind CUDA, both in features and ease of use, making it much harder to reach feature and performance parity with CUDA.

The second big problem is that AMD has a history of abandoning APIs. While Nvidia has been focusing on CUDA from the start, AMD is on its third or fourth API. A lot of developers got burned early on by putting in a lot of effort into supporting AMD cards, only to have their work become useless as AMD dropped old API.

So if you wanted to support AMD today you have to choose between using their latest API which is currently only supported on a handful of their latest top end cards, or using their previous API, which is much worse and may or may not be supported in 2 years time.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by slavik81 on Monday August 21, 2023 @12:55AM (#37205628)
> their latest API [...] is currently only supported on a handful of their latest top end cards

While there's very few cards that are officially supported, I've enabled most RDNA 1 and RDNA 2 GPUs in the OS-provided packages on Debian Unstable and Ubuntu 23.10. I haven't tested all of them, but my experience has been that they generally work quite well. The version of HIP packaged for Debian is still a few versions behind, so we haven't been able to enable RDNA 3 yet, but it shouldn't be too long before that is resolved.

As you have described, it has been a very long road to get to this point (with a lot of mistakes along the way), but I think things are getting better. That said, I work on ROCm, so my evaluation may be unintentionally biased.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by dagw on Monday August 21, 2023 @04:17AM (#37206724)
I think things are getting better

Hopefully. Although I haven't programmed with it yet, the latest ROCm looks nice (at least from reading the docs). Now all you have to do is actually get to a point where it's actually supported on hardware people actually own and convince people that it's worth investing their time in, and then AMD can start making progress.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by slavik81 on Monday August 21, 2023 @08:03PM (#37216913)
The Debian packages support a much wider range of hardware than the AMD packages do. Just about any discrete AMD GPU hardware released in the past five years should already work or will work soon.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by ekianjo on Sunday August 20, 2023 @04:02AM (#37197106)
No CUDA is heavily integrated with how Nvidia hardware operates
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by Karliss on Sunday August 20, 2023 @06:47AM (#37197897)
Nvidia has provided the same API incrementally extending it since 2007. And supported it on most of their GPUS including consumer cards. Oldest cards supported by the latest version of their SDK were made in ~2013-2016. See table in https://en.wikipedia.org/wiki/CUDA#GPUs_supported

AMD has been a lot less consistent with their support changing their mind almost every 3 years. ROCm was initially released in 2016 (that's 9 years of headstart for NVIDIA). If you look at https://docs.amd.com/en/latest/release/gpu_os_support.html on Linux only the enterprise server cards are supported. Situation slightly different on windows https://docs.amd.com/en/latest/release/windows_support.html where they support last 2 generations of consumer cards (partially). I remember there were also a few years with even more bizarre situation where they supported GPUs that are couple of generations old but not their latest cards.

Not hard to see how developers are hesitant to spend time adding support for AMD if large portion of AMD users won't be able to use it and there is a high chance that after few years AMD will change their mind again coming out with new API or dropping support for cards that are only couple of years old.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by whywhywhywhy on Sunday August 20, 2023 @07:55AM (#37198268)
CUDA has over a decade of tooling and talent built up while AMD/Apple fumbled with the far more awkward to develop with OpenCL that they eventually killed.

This disparity is due to that fumble.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by mmis1000 on Sunday August 20, 2023 @12:02PM (#37200390)
The software support for AMD gpu is probably lags 10 years or so after Nvidia. They just release there sdk for windows this year (more specifically 2023-05-24, Rocm 5.5.1). While CUDA exists for both platform like forever. So there won't be a common user group besides some lab (which have the man power to invest in linux software and setup new tool chains) that use AMD card for AI related task.

But since Rocm for windows finally released. The situation may finally change. We can probably just wait and see what will go on.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by selfhoster11 on Monday August 21, 2023 @04:12AM (#37206685)
My impression was rather that CUDA is successful because it will work on any NVidia GPU that's not yet old enough to vote, which means a number of things:

- people had lots of time to get used to it

- hobbyists and smaller research outfits/labs could make use of it on the cheap and less powerful hardware (where even a cheap GPGPU beats computing in software), driving:

  - mind share (compare: Photoshop/Microsoft's tolerance to piracy)

  - sales of hardware when the users decided to upgrade, buying more and/or and/or more modern and/or better cards
- the longer it has been available, the more stable of a programming target it appears to be, driving a virtuous cycle

In contrast, the range of AMD hardware supporting ROCm was narrow and unstable (AFAIK one card was only supported for a couple of years). This would of course make ROCm unattractive for building with, especially for the hobbyists and smaller outfits that would otherwise drive mindshare but couldn't afford datacenter grade hardware that was supported.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by mmis1000 on Monday August 21, 2023 @05:48AM (#37207284)
Recent rocm on windows also supports more cards than it used to be. Consumer rdna2/3 cards are mostly on the support list. Although these only available on windows for some reason. And the only consumer card supported on linux is still 'AMD Radeon™ VII'.

No idea if AMD will drop whole list like it previously done this time though.

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by anshukg on Sunday August 20, 2023 @03:16AM (#37196929)
I don't know , I think it is still plenty of time before nvidia could have a serious competitor for value : https://medium.com/@1kg/nvidias-cuda-monopoly-6446f4ef7375
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by EtienneK on Sunday August 20, 2023 @03:42AM (#37197017)
Again, I was referring to gaming and not AI since the comment I commented on mentioned consoles.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by ekianjo on Sunday August 20, 2023 @04:03AM (#37197113)
Why selectively apply your filter for gaming only when Nvidi does everything
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by jamespo on Sunday August 20, 2023 @04:45AM (#37197289)
because the two markets don't really overlap?
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by ekianjo on Sunday August 20, 2023 @06:25AM (#37197794)
By all metrics the AI market is much bigger
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by jamespo on Wednesday August 23, 2023 @10:05AM (#37236098)
Irrelevant to my point and doesn't refute it
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by xcdzvyn on Sunday August 20, 2023 @04:49AM (#37197311)
CUDA does not monopolise GPGPU. There are other offerings, they're just not good enough.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by ekianjo on Sunday August 20, 2023 @04:01AM (#37197101)
Gaming is only a very small part of what you expect from GPUs these days
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by sva_ on Sunday August 20, 2023 @05:14AM (#37197452)
I wouldn't be so sure about that. There are hundreds of millions, if not billions of gamers, many of which use GPUs.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by ekianjo on Sunday August 20, 2023 @06:27AM (#37197802)
Its a stable market. Its not growing like the AI market is and Nvidia makes much higher margins by selling GPUs to the enterprise market. Gaming is bound to become a tiny piece of the pie.
Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by NBJack on Sunday August 20, 2023 @05:28PM (#37203081)
For a time, so was bitcoin mining.

ML hardware sales are being driven by a 'Renaissance' of rapid model development and commercial offerings, primarily by the FAANG, but several others too. This is neat, but beyond the initial waves, OpenGPT isn't exactly the digital messiah many suggested it was, and running these models is expensive (both in HW and power for it). Time will tell, but I am skeptical this will be more than a craze for most applications (except digital art, which is awesome and has already been proven effective; just not maybe as marketable to the masses).

Re:AMD's 7900 XTX achieves better value for Stable Diffusion... by xiphias2 on Sunday August 20, 2023 @07:36AM (#37198171)
AI market just caught up with gaming this year. But aa it's growing faster than gaming, in a few years GPUs have to improve more in AI performance (matmul ops and interconnect) than gaming.