News for hackers. Stuff that matters.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by fulafel on Wednesday May 31, 2023 @12:58AM (#36134626)
Google has advertised that they have better perf/$ than GPUs, is this wrong or do you just mean absolute cost (so not available in small enough slices)?

edit: actually now i can't find the claim, maybe i misremember what the papers said.

Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by mochomocha on Wednesday May 31, 2023 @01:16AM (#36134718)
Perf/$ where $ is what it cost _them_ , not $ they're ready to sell to others as a product. Cloud margins in the high two-digit percents are typical, and I'd imagine even higher for very specialized products in high-demand from deep-pocketed customers.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by sanxiyn on Wednesday May 31, 2023 @02:29AM (#36135168)
https://arxiv.org/abs/2304.01433 does claim "1.2x-1.7x faster and uses 1.3x-1.9x less power than the NVIDIA A100".