Re:Show HN: Run Stable Diffusion Directly on iPhone
by liuliu on Friday January 12, 2024 @12:09PM
(#38970760)
iPhone 15 Pro with 30 steps at 512x512 resolution (SD v1.5) should take around 35 seconds on iPhone 15 Pro with Draw Things. 1.5 mins are too slow. (I am the author of DT).
[ Parent
| on HN ]
Re:Show HN: Run Stable Diffusion Directly on iPhone
by mofle on Friday January 12, 2024 @12:26PM
(#38970986)
It could indeed be faster. The app does not currently use the neural engine (ANE) because it has a tendency to crash the app, so it uses only CPU and GPU. The app also does upscaling, which adds ~10 seconds.
Re:Show HN: Run Stable Diffusion Directly on iPhone
by liuliu on Friday January 12, 2024 @12:28PM
(#38971041)
I am going to put model related code we use in a public repo soon (it is very similar to https://github.com/liuliu/swift-diffusion but in NHWC format). ANE will be around 25s if it runs. DT's default only uses GPUs and 35s is on GPU (yes, like you said, upscaling would take extra 10s).