News for hackers. Stuff that matters.

A comment on H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark.

Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark by mrcggl on Wednesday June 28, 2023 @05:38AM (#36504269)
A large H100 cluster (>10k GPUs) could likely train a LLM with 10x compute (FP8) of GPT-4, which was apparently trained on a mix of A100s and V100s.
[ Parent | on HN ]

There are no comments on this comment yet.