News for hackers. Stuff that matters.
Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark by godelski on Wednesday June 28, 2023 @02:03PM (#36510218)
We're talking about building a server, so usually availability is different than to a home consumer. But fwiw lambda has their Node for 330k (which gets pretty close to that price), whereas the A100's are $170k, so double my figure. Especially considering the H100 nodes are 8U instead of 4U. so you need twice as many racks.
Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark by m00x on Thursday June 29, 2023 @01:21PM (#36523522)
30k is to businesses, not consumers. Consumers don't buy H100s.