Re:Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM
by kkielhofner on Wednesday June 07, 2023 @12:44PM
(#36229421)
Probably the best reference is HN itself. Look at the dozens of GPGPU projects, articles, papers, etc that hit the front page in any given week. Then look to see how many of them support AMD/ROCm. Spoiler alert: virtually zero.
That's compelling enough to justify the position here but you can do further research to explore the challenges with other platforms (like ROCm). Just glance at issue trackers for Pytorch, Tensorflow, and higher level projects that (rarely) support ROCm - you will notice a clear trend. Even though CUDA is more capable and outnumbers AMD use 10:1 the issues reported currently are:
Pytorch
Search for ROCm - 2,557 issues open (~10% market share)
Search for CUDA - 5,430 issues open (at least 80% market share)
Even in the limited cases where it's attempted the capability and experience with AMD/ROCm is significantly worse, to the point of "almost no one even bothers anymore" (see my top paragraph).
That's compelling enough to justify the position here but you can do further research to explore the challenges with other platforms (like ROCm). Just glance at issue trackers for Pytorch, Tensorflow, and higher level projects that (rarely) support ROCm - you will notice a clear trend. Even though CUDA is more capable and outnumbers AMD use 10:1 the issues reported currently are:
Pytorch
Search for ROCm - 2,557 issues open (~10% market share)
Search for CUDA - 5,430 issues open (at least 80% market share)
Even in the limited cases where it's attempted the capability and experience with AMD/ROCm is significantly worse, to the point of "almost no one even bothers anymore" (see my top paragraph).