Re:Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Co...
by pjmlp on Sunday January 07, 2024 @04:59AM
(#38899931)
And CUDA is not only C++, rather a quite mature polyglot ecosystem, with graphical debugging and plenty of frameworks to chose from.
Also to note, most folks that are driving ISO C++ heterogenous compute story are actually NVidia employees.
Re:Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Co...
by danielEM on Sunday January 07, 2024 @05:01AM
(#38899943)
> If it were easy, trust me, Nvidia and AMD would both pile on RAM and charge out the wazoo for it. I mean... look at the price difference between an A100 40GB and A100 80GB. They're the same chipset and there's a 2x price difference. Though I should mention the 80GB version is faster memory too
No one nowadays throws a price based on costs + margin for R&D and little extra stay afloat. Those times seem to end somewhere early in 2000s. I wouldn't be surprised at all if that extra 40GB of faster RAM is in 30% cost increase range.
Re:Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Co...
by andrewstuart on Sunday January 07, 2024 @05:58AM
(#38900178)
Cost matters.
Re:Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Co...
by qwytw on Sunday January 07, 2024 @07:23AM
(#38900656)
> look at the price difference between an A100 40GB and A100 80GB
Nvidia is effectively a monopoly. They can charge whatever they want regardless of cost (which is what they are doing according to their reported margins)
No, because that's not the only part of the system that matters. This indeed would be useful and Nvidia sure is pushing for more memory (note that they are also continuing development on GPUDirect), but there are limitations. Strapping a SSD onto the side isn't really going to make things any better.
Nvidia's secret sauce is CUDA. AMD has been doing great, but they still got a long way to go here. They caught up on hardware, but that's maybe half the battle? If it weren't, you'd see ML people flocking to AMD for lower prices and simply due to availability.
It's not that these companies are stingy with RAM, it is that GPU RAM isn't the same RAM you throw into your motherboard. They do have differences.
If it were easy, trust me, Nvidia and AMD would both pile on RAM and charge out the wazoo for it. I mean... look at the price difference between an A100 40GB and A100 80GB. They're the same chipset and there's a 2x price difference. Though I should mention the 80GB version is faster memory too.