Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by ftxbro on Tuesday May 30, 2023 @10:40PM
(#36133865)
What does this mean for the AI race? For example what if a newish company (newer than Google/Facebook/Microsoft/etc.) like Anthropic, Scale, Perplexity, or Stability is able to scrape together $5B USD funding and spend their hardware budget on these things. Say that can buy $1B of them and spend the rest on hackers and operating expenses (idk if that's realistic). So maybe they could purchase and operate like 20 of them. Say that they spend six months doing experimental things and then the next six months training their Tsar Model. If they follow the Chinchilla scaling laws and normal architectures, how good will these models be?
[ Parent
| on HN ]
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by bushbaba on Tuesday May 30, 2023 @11:05PM
(#36134031)
For AI race means it opens the door to a competitor. Could be AMD, Google, or Amazon. All which have offerings in this space.
However while the hardware isn’t cheap, it’s still likely not a blocker. Costs do inhibitor more experimental research.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by mirekrusin on Wednesday May 31, 2023 @01:42AM
(#36134886)
Startup which will rent this compute when needed will likely have more advantage on AI front.
Selling shovels is good business, but doesn't compete directly in AI area.