News for hackers. Stuff that matters.

A comment on Stable Diffusion XL technical report [pdf]. Parent comment

Re:Stable Diffusion XL technical report [pdf] by GaggiX on Wednesday July 05, 2023 @07:13AM (#36598680)
I was going to search on the internet about it, but then I realized you are the author (and there is nothing online I think). I imagine that the activations are left in FP16 and the weights are converted in FP16 during inference, right?

Btw very cool

[ Parent | on HN ]
Re:Stable Diffusion XL technical report [pdf] by liuliu on Wednesday July 05, 2023 @12:22PM (#36602655)
Yes, computes are carried out in FP16 (so there is no compute efficiency gains, might be latency reductions due to memory-bandwidth saving). These savings are not realized yet because no custom kernels introduced yet.
[ Parent | on HN ]