News for hackers. Stuff that matters.
Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark by m00x on Wednesday June 28, 2023 @02:05AM (#36502866)
H100s are now around 30k USD if you're lucky, going up to 40k on Ebay/Amazon.

3,584 GPUs at $30,000 is $104,550,000 USD only in GPUs.

Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark by godelski on Wednesday June 28, 2023 @02:03PM (#36510218)
We're talking about building a server, so usually availability is different than to a home consumer. But fwiw lambda has their Node for 330k (which gets pretty close to that price), whereas the A100's are $170k, so double my figure. Especially considering the H100 nodes are 8U instead of 4U. so you need twice as many racks.
Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark by m00x on Thursday June 29, 2023 @01:21PM (#36523522)
30k is to businesses, not consumers. Consumers don't buy H100s.