Show HN: Shortbread, create AI comics in minutes

Re:Show HN: Shortbread, create AI comics in minutes by fengjiaopeng on Friday October 06, 2023 @01:57PM (#37793898)

Woaaa love these inputs. Thank you! Wasn't aware of the JAX backend will check it out. Right now we're on SD 1.5. We tried SDXL but found the quality improvement to be marginal. Yes to area prompting/regional control to help people create more complex scenes. I need some design thinking first since it's easy to over build and spit out something super complicated. Immediate next step is to def add controlnet.

[ Parent | on HN ]

Re:Show HN: Shortbread, create AI comics in minutes by brucethemoose2 on Friday October 06, 2023 @02:02PM (#37793981)

> JAX

Yeah, check out their post: https://huggingface.co/blog/sdxl_jax

I dunno how expensive TPU instances are these days, but the performance is insane!

> We tried SDXL but found the quality improvement to be marginal.

Yeah, the vanilla HF diffusers pipe is unimpressive to me.

Try playing with this though, turn on FreeU and specify an anime style: https://github.com/MoonRide303/Fooocus-MRE

I have never gotten such high quality results from simple prompts, even in cloud models like Midjourney/GPT4. The question is how to port even part of that magic over to the diffusers pipeline...

[ Parent | on HN ]

Re:Show HN: Shortbread, create AI comics in minutes by brucethemoose2 on Friday October 06, 2023 @02:06PM (#37794027)

Also, VoltaML has a good reference GPU AITemplate SD 1.5 implementation:

https://github.com/VoltaML/voltaML-fast-stable-diffusion/tre...

The speed jump is massive on my desktop GPU, probably even more dramatic on cloud hardware, and it may support some things (weight swapping/lora swapping/resolution changing/controlnet) better than JAX.

[ Parent | on HN ]

Re:Show HN: Shortbread, create AI comics in minutes by fengjiaopeng on Friday October 06, 2023 @04:05PM (#37795603)

My issue previously with these prebuilt backends is that you can't tweak it like sdwebui does, but to make our thing work it took a thousand tweaks. Can look into this first to see how customizable it is.

[ Parent | on HN ]

Re:Show HN: Shortbread, create AI comics in minutes by brucethemoose2 on Friday October 06, 2023 @04:19PM (#37795812)

VoltaML is a relatively vanilla diffusers-based backend, so its not a hairy monster to hack like you may have seen with SAI-based UIs (like Comfy, Fooocus and Automatic)

The AITTemplate code is a lightly modified version of Facebook's example dynamic AIT script, to get rid of small issues like VRAM spikes: https://github.com/facebookincubator/AITemplate/tree/main/ex...

InvokeAI is also diffusers based, but they seem to mess with the pipeline a bit more.

Anyway, all that may be better as a reference for interesting features rather than a backend to try and adopt.

[ Parent | on HN ]