StableDiffusion can now run directly in the browser on WebGPU

Re:StableDiffusion can now run directly in the browser on We... by bb88 on Monday July 17, 2023 @10:02PM (#36766849)

Anyone have metrics on this on performance in webgpu vs running this natively?

[ Parent | on HN ]

Re:StableDiffusion can now run directly in the browser on We... by aislamov on Monday July 17, 2023 @10:08PM (#36766904)

UNET takes about a 1:10 on WebGPU and around a minute on CPU in one thread. VAE is 2 minutes on CPU and about 10 seconds on GPU. It should be because most GPU ops for VAE are already implemented but for UNET are not. So in the latter case browser is just tossing data from GPU to CPU and back on each step

[ Parent | on HN ]