News for hackers. Stuff that matters.
Re:Megaface by polygamous_bat on Monday January 02, 2023 @03:03PM (#34222905)
One, the diffusion model's possible output space contains every RGB image ever. But two, it cannot ever possibly contain the original inputs verbatim, because (the size of the model)/(the size of the training set) comes out to be something like 0.2 KB per image. Unless it's an incredible compression algorithm, diffusion necessarily have learned something from the input rather than copy-pasting things, as claimed upthread.
Re:Megaface by schemescape on Monday January 02, 2023 @03:40PM (#34223345)
I edited my post a while ago, but I shouldn't have said "verbatim". See reply to sibling for more what I had in mind.
Re:Megaface by TeMPOraL on Monday January 02, 2023 @06:00PM (#34224925)
> Unless it's an incredible compression algorithm, diffusion necessarily have learned something from the input rather than copy-pasting things, as claimed upthread.

Arguably, "learning" and "compression" are the same thing.

In this sense, you can view SD as a compression algorithm where the decoder is the model, the compressed file is the prompt + tweakable params, and there aren't any error checks made, so you can feed random data into the decoder and get something out.

Re:Megaface by int_19h on Tuesday January 03, 2023 @05:10PM (#34238828)
Or maybe the compressed file is the model, and prompt + tweakable params is a "path" inside that compressed file?