News for hackers. Stuff that matters.

A comment on A Web UI for Stable Diffusion. Parent comment

Re:A Web UI for Stable Diffusion by wyldfire on Friday September 09, 2022 @05:32PM (#32785179)
It sounds like there's forks that are able to work with <=8GB cards. And I'm not sure but I think the weights are using f32, so switching to half might make it yet easier still to get this to work w/less memory.

But yeah the next generation of models would probably capitalize on more memory somehow.

[ Parent | on HN ]
Re:A Web UI for Stable Diffusion by filiphorvat on Friday September 09, 2022 @06:06PM (#32785460)
People have reported that this repo even works with 2gb cards if you run it with --lowvram and --opt-split-attention.
[ Parent | on HN ]
Re:A Web UI for Stable Diffusion by password4321 on Friday September 09, 2022 @06:39PM (#32785761)
Yes, the amount of VRAM doesn't seem to be as much of a limitation anymore. However, processing power is still important.
[ Parent | on HN ]