News for hackers. Stuff that matters.
Re:Fast-stable-diffusion colabs, +25% speed increase and mem... by bloaf on Monday September 26, 2022 @03:48PM (#32987452)
These guys claim a 50% speedup with a similar approach:

https://www.reddit.com/r/StableDiffusion/comments/xmr3ic/spe...

Re:Fast-stable-diffusion colabs, +25% speed increase and mem... by eoerl on Tuesday September 27, 2022 @03:05AM (#32992308)
yep, same approach but it arrived 3 days later and there's no mention of the [original PR](https://github.com/huggingface/diffusers/pull/532#issuecomme...), nice. Else the kernels used in that case -upstream flash attention- are not compatible with all nvidia GPU generations, FYI (xformers' cover a wider range and are generally faster or just pull Flash')