News for hackers. Stuff that matters.
Re:Run Stable Diffusion on Your M1 Mac’s GPU by avereveard on Thursday September 01, 2022 @12:56PM (#32679312)
How fast is it on a m1?
Re:Run Stable Diffusion on Your M1 Mac’s GPU by ebiester on Thursday September 01, 2022 @12:57PM (#32679335)
It takes 1-2 mins for a 512x512 image. It's been a lot of fun since I did this last night.
Re:Run Stable Diffusion on Your M1 Mac’s GPU by smoldesu on Thursday September 01, 2022 @01:42PM (#32680114)
For reference, inferencing the model on a 2070 takes 10-12 seconds for the same size at max-precision, and the 3070 can synthesize an image in almost 6 seconds.

If you extrapolate the power consumption (3070 @~300w vs M1 Pro GPU@~30-50w) the metrics make a lot of sense.

Re:Run Stable Diffusion on Your M1 Mac’s GPU by pwinnski on Thursday September 01, 2022 @02:50PM (#32681188)
The answer depends VERY MUCH on RAM.

My M1 with 8GB takes 70-90 minutes per image.

My M1 Pro with 16GB takes 3 minutes per image.

Re:Run Stable Diffusion on Your M1 Mac’s GPU by fifafu on Thursday September 01, 2022 @04:54PM (#32683054)
Another data point: M1 Max with 64GB takes ~40 seconds
Re:Run Stable Diffusion on Your M1 Mac’s GPU by astrange on Thursday September 01, 2022 @06:54PM (#32684442)
Hopefully the library is intentionally going very slowly trying to fit in RAM and that's not just your 8GB machine totally falling over.
Re:Run Stable Diffusion on Your M1 Mac’s GPU by pwinnski on Friday September 02, 2022 @11:17AM (#32691816)
Sadly, in this case it's the 8GB machine falling over.
Re:Run Stable Diffusion on Your M1 Mac’s GPU by Birch-san on Friday September 02, 2022 @03:32AM (#32687729)
9.3 secs if you sample for 7 steps. 11 secs if you sample for 8 steps. Heun sampler, M1 Max. https://twitter.com/Birchlabs/status/1564792349221330944?s=2...
Re:Run Stable Diffusion on Your M1 Mac’s GPU by nathas on Thursday September 01, 2022 @12:58PM (#32679359)
I haven't ran this fork yet, but about 1.3 sec/iter. Usually ~30-50 iters/sample (image).