Re:Nvidia H100 GPUs: Supply and Demand
by ggreg84 on Tuesday August 01, 2023 @01:12PM
(#36958993)
Excellent example. A supercomputer built with somebody elses money (tax payers) for use by relatively cheap phd students funded by somebody elses money (tax payers), to... maybe some day do some AI... but if they don't, that's fine. [0]
The level of risk tolerance of such a user is essentially infinite, to the point that your AI cluster can arrive 8 years late (Intel and Aurora), and you are still fine.
What makes sense for such user, might not make sense for a private company whose survival depends on expensive engineers quickly generating value in a competitive market.
So the example is really perfect: those with infinite risk tolerance go with AMD GPUs for AI today.
The level of risk tolerance of such a user is essentially infinite, to the point that your AI cluster can arrive 8 years late (Intel and Aurora), and you are still fine.
What makes sense for such user, might not make sense for a private company whose survival depends on expensive engineers quickly generating value in a competitive market.
So the example is really perfect: those with infinite risk tolerance go with AMD GPUs for AI today.
Maybe some day this will change.
[0] https://lumi-supercomputer.github.io/LUMI-training-materials...