News for hackers. Stuff that matters.

A comment on Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut. Parent comment

Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by tehsauce on Friday September 09, 2022 @12:39AM (#32775372)
It was about $200k in compute.
[ Parent | on HN ]
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by moonshotideas on Friday September 09, 2022 @01:01AM (#32775493)
Is there a breakdown of the costs available to view?
[ Parent | on HN ]
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by homarp on Friday September 09, 2022 @01:21AM (#32775596)
https://twitter.com/emostaque/status/1563870674111832066 says "We actually used 256 A100s for this per the model card, 150k hours in total so at market price $600k"
[ Parent | on HN ]
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by godmode2019 on Friday September 09, 2022 @03:41AM (#32776464)
But they still have those A100s?

I think you have to compare it to how much ETH you could have mined as the opportunity cost of training a model vs other uses of a GPU

[ Parent | on HN ]
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by l33tman on Friday September 09, 2022 @04:45AM (#32776903)
I think it was donated by AWS or something. This is not a scenario where it makes sense to buy and maintain your own server park of GPUs, when there is a race to the bottom already with cloud-based GPU rentals.
[ Parent | on HN ]
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by homarp on Friday September 09, 2022 @06:46AM (#32777657)
Also compare the impact of releasing Stable Diffusion vs 'yet another coin'/web3 announcement.
[ Parent | on HN ]
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by homarp on Friday September 09, 2022 @05:11PM (#32784967)
https://www.forbes.com/sites/kenrickcai/2022/09/07/stability...
[ Parent | on HN ]