Re:Show HN: Shortbread, create AI comics in minutes
by fengjiaopeng on Friday October 06, 2023 @04:05PM
(#37795603)
My issue previously with these prebuilt backends is that you can't tweak it like sdwebui does, but to make our thing work it took a thousand tweaks. Can look into this first to see how customizable it is.
Re:Show HN: Shortbread, create AI comics in minutes
by brucethemoose2 on Friday October 06, 2023 @04:19PM
(#37795812)
VoltaML is a relatively vanilla diffusers-based backend, so its not a hairy monster to hack like you may have seen with SAI-based UIs (like Comfy, Fooocus and Automatic)
The AITTemplate code is a lightly modified version of Facebook's example dynamic AIT script, to get rid of small issues like VRAM spikes: https://github.com/facebookincubator/AITemplate/tree/main/ex...
InvokeAI is also diffusers based, but they seem to mess with the pipeline a bit more.
Anyway, all that may be better as a reference for interesting features rather than a backend to try and adopt.
https://github.com/VoltaML/voltaML-fast-stable-diffusion/tre...
The speed jump is massive on my desktop GPU, probably even more dramatic on cloud hardware, and it may support some things (weight swapping/lora swapping/resolution changing/controlnet) better than JAX.