Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark
by godelski on Wednesday June 28, 2023 @02:03PM
(#36510218)
We're talking about building a server, so usually availability is different than to a home consumer. But fwiw lambda has their Node for 330k (which gets pretty close to that price), whereas the A100's are $170k, so double my figure. Especially considering the H100 nodes are 8U instead of 4U. so you need twice as many racks.
[ Parent
| on HN ]