News for hackers. Stuff that matters.

A comment on Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut. Parent comment

Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by 01100011 on Friday September 09, 2022 @03:47AM (#32776497)
Obviously perf and efficiency would be terrible, but could you distribute the training of a diffusion model across volunteers' computers? I would think that, for many fangroups, you'd have a lot of folks who would like to customize a diffusion model for their favorite characters and/or art.
[ Parent | on HN ]
Re:Nvidia Hopper Sweeps AI Inference Benchmarks in MLPerf Debut by sanxiyn on Friday September 09, 2022 @09:59PM (#32786963)
Likely yes, it already has been done for DALL-E. Have a look at Training Transformers Together for what is involved: https://arxiv.org/abs/2207.03481.
[ Parent | on HN ]