Re:Run Stable Diffusion on Your M1 Mac’s GPU
by JimmyAustin on Thursday September 01, 2022 @02:42PM
(#32681050)
I suspect that the M2 air is thrashing the disk pretty aggressively. Diffusion models rerun the same model once per step, so for a generation with 50 steps, you copy the entire model in and out of memory 50 times. That's going to kill performance.
[ Parent
| on HN ]
Re:Run Stable Diffusion on Your M1 Mac’s GPU
by bm-rf on Thursday September 01, 2022 @02:47PM
(#32681134)
I believe the model is copied into ram once upon calling StableDiffusionPipeline, unless the mac implementation partially loads the model due to only having 8G of ram.
Re:Run Stable Diffusion on Your M1 Mac’s GPU
by schleck8 on Thursday September 01, 2022 @02:52PM
(#32681218)
It's only copied to VRAM once when implemented correctly.