News for hackers. Stuff that matters.
Re:Run Stable Diffusion on Your M1 Mac’s GPU by JimmyAustin on Thursday September 01, 2022 @02:42PM (#32681050)
I suspect that the M2 air is thrashing the disk pretty aggressively. Diffusion models rerun the same model once per step, so for a generation with 50 steps, you copy the entire model in and out of memory 50 times. That's going to kill performance.
Re:Run Stable Diffusion on Your M1 Mac’s GPU by bm-rf on Thursday September 01, 2022 @02:47PM (#32681134)
I believe the model is copied into ram once upon calling StableDiffusionPipeline, unless the mac implementation partially loads the model due to only having 8G of ram.
Re:Run Stable Diffusion on Your M1 Mac’s GPU by schleck8 on Thursday September 01, 2022 @02:52PM (#32681218)
It's only copied to VRAM once when implemented correctly.
Re:Run Stable Diffusion on Your M1 Mac’s GPU by astrange on Thursday September 01, 2022 @05:36PM (#32683608)
M1 is a unified memory system and doesn't have VRAM.
Re:Run Stable Diffusion on Your M1 Mac’s GPU by schleck8 on Thursday September 01, 2022 @07:30PM (#32684738)
I know, I was just adding context.