News for hackers. Stuff that matters.
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by dannyw on Thursday September 08, 2022 @11:40PM (#32775048)
Even $10k is enough for a hobbyist group or crowd funding.
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by Ajedi32 on Friday September 09, 2022 @12:54AM (#32775452)
Crowd funding models seems especially interesting, since in theory you could fully automate the process. Submit the dataset and code you want to train with, then once it's funded the service automatically runs the training and releases the resulting model to backers.
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by macrolime on Friday September 09, 2022 @02:25AM (#32775936)
Such a platform should include a cloud to run the model, where backers would share the revenue earned from people using the model through an API.
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by ipsum2 on Friday September 09, 2022 @12:35AM (#32775336)
Stable diffusion is on the order of millions of dollars.
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by tehsauce on Friday September 09, 2022 @12:39AM (#32775372)
It was about $200k in compute.
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by moonshotideas on Friday September 09, 2022 @01:01AM (#32775493)
Is there a breakdown of the costs available to view?
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by homarp on Friday September 09, 2022 @01:21AM (#32775596)
https://twitter.com/emostaque/status/1563870674111832066 says "We actually used 256 A100s for this per the model card, 150k hours in total so at market price $600k"
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by godmode2019 on Friday September 09, 2022 @03:41AM (#32776464)
But they still have those A100s?

I think you have to compare it to how much ETH you could have mined as the opportunity cost of training a model vs other uses of a GPU

Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by l33tman on Friday September 09, 2022 @04:45AM (#32776903)
I think it was donated by AWS or something. This is not a scenario where it makes sense to buy and maintain your own server park of GPUs, when there is a race to the bottom already with cloud-based GPU rentals.
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by homarp on Friday September 09, 2022 @06:46AM (#32777657)
Also compare the impact of releasing Stable Diffusion vs 'yet another coin'/web3 announcement.
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by homarp on Friday September 09, 2022 @05:11PM (#32784967)