Re:Ash HN: How do you distribute or shard Stable Diffusion?
by yolo4553 on Sunday September 11, 2022 @07:35AM
(#32798769)
As long as you want to create many small images (like 512x512) you can spread it over multiple GPU.
A friend is running cloud instances with up to 8x GPU and 8x stable infusion + api in parallel. He uses simple a simple round robin with a reverse proxy in front to spread the work.
AFAIK there is no feasible method to spread work on the same image over multiple GPU yet.
A friend is running cloud instances with up to 8x GPU and 8x stable infusion + api in parallel. He uses simple a simple round robin with a reverse proxy in front to spread the work.
AFAIK there is no feasible method to spread work on the same image over multiple GPU yet.