News for hackers. Stuff that matters.

A comment on Stable Diffusion PR optimizes VRAM, generate 576x1280 images with 6 GB VRAM. Parent comment

Re:Stable Diffusion PR optimizes VRAM, generate 576x1280 ima... by frognumber on Saturday September 03, 2022 @11:24PM (#32709501)
That's weird. I cap out at 512x512 on my 16GB Ampere card. Even stepping down precision doesn't help. I wonder what's different.

I use it directly from Python.

[ Parent | on HN ]
Re:Stable Diffusion PR optimizes VRAM, generate 576x1280 ima... by MattRix on Sunday September 04, 2022 @02:54AM (#32710550)
You might have the n_samples (aka batch size) set to a number greater than 1? That basically multiplies the amount of VRAM you’re using.

I can generate a 512x512 on my 10gb 3080 no problem (or three 384x384 at a time)

[ Parent | on HN ]
Re:Stable Diffusion PR optimizes VRAM, generate 576x1280 ima... by temp_account_32 on Sunday September 04, 2022 @10:28AM (#32713424)
Try the hlky fork: https://github.com/hlky/stable-diffusion

It measures memory usage as well.

[ Parent | on HN ]
Re:Stable Diffusion PR optimizes VRAM, generate 576x1280 ima... by prox on Sunday September 04, 2022 @12:14AM (#32709764)
Perhaps a different kind of chipset that isn’t optimized yet? Just a guess based on other graphics processes.
[ Parent | on HN ]