Re:Run Stable Diffusion on Your M1 Mac’s GPU
by avereveard on Thursday September 01, 2022 @12:56PM
(#32679312)
How fast is it on a m1?
[ Parent
| on HN ]
Re:Run Stable Diffusion on Your M1 Mac’s GPU
by ebiester on Thursday September 01, 2022 @12:57PM
(#32679335)
It takes 1-2 mins for a 512x512 image. It's been a lot of fun since I did this last night.
Re:Run Stable Diffusion on Your M1 Mac’s GPU
by smoldesu on Thursday September 01, 2022 @01:42PM
(#32680114)
For reference, inferencing the model on a 2070 takes 10-12 seconds for the same size at max-precision, and the 3070 can synthesize an image in almost 6 seconds.
If you extrapolate the power consumption (3070 @~300w vs M1 Pro GPU@~30-50w) the metrics make a lot of sense.
Re:Run Stable Diffusion on Your M1 Mac’s GPU
by pwinnski on Thursday September 01, 2022 @02:50PM
(#32681188)
The answer depends VERY MUCH on RAM.
My M1 with 8GB takes 70-90 minutes per image.
My M1 Pro with 16GB takes 3 minutes per image.
Re:Run Stable Diffusion on Your M1 Mac’s GPU
by fifafu on Thursday September 01, 2022 @04:54PM
(#32683054)
Another data point:
M1 Max with 64GB takes ~40 seconds
Re:Run Stable Diffusion on Your M1 Mac’s GPU
by astrange on Thursday September 01, 2022 @06:54PM
(#32684442)
Hopefully the library is intentionally going very slowly trying to fit in RAM and that's not just your 8GB machine totally falling over.
Re:Run Stable Diffusion on Your M1 Mac’s GPU
by pwinnski on Friday September 02, 2022 @11:17AM
(#32691816)
Sadly, in this case it's the 8GB machine falling over.
Re:Run Stable Diffusion on Your M1 Mac’s GPU
by Birch-san on Friday September 02, 2022 @03:32AM
(#32687729)
9.3 secs if you sample for 7 steps. 11 secs if you sample for 8 steps.
Heun sampler, M1 Max.
https://twitter.com/Birchlabs/status/1564792349221330944?s=2...