News for hackers. Stuff that matters.

A comment on Running Stable Diffusion fully in browser with WebGPU.

Re:Running Stable Diffusion fully in browser with WebGPU by sberens on Wednesday March 08, 2023 @02:01PM (#35073281)
> As WebGPU does not support FP16 at this moment, the memory consumption of running the demo is about 7GB. For Apple silicon Mac with only 8GB of unified memory, it may take longer (a few minutes) to generate an image. This demo may also work for Mac with AMD GPU.

Ouch. It will be interesting what this number will look like in 2-3 years though.

[ Parent | on HN ]
Re:Running Stable Diffusion fully in browser with WebGPU by crowwork on Wednesday March 08, 2023 @02:02PM (#35073292)
on apple M2max, it takes 20sec, and with the fp16 support, there will be opportunities for improvement likely soon this eyar
[ Parent | on HN ]