News for hackers. Stuff that matters.

A comment on ControlNET and Stable Diffusion: A Game Changer for AI Image Generation. Parent comment

Re:ControlNET and Stable Diffusion: A Game Changer for AI Im... by synapticpaint on Monday February 20, 2023 @08:57AM (#34868091)
"The flickering comes from the fundamental nature of the de-noising mechanism involved in the diffusion model." -- agreed

"Keeping the same seed wouldn't be helpful if you want the image to move." -- No, I'm using the same seed (and prompt). The image moves because ControlNet opens up another channel of input, in this case the pose data.

[ Parent | on HN ]
Re:ControlNET and Stable Diffusion: A Game Changer for AI Im... by Lerc on Monday February 20, 2023 @02:40PM (#34871966)
Yes but that still produces temporal aliasing because the unmoving noise is battling the moving controlnet input. I can't find it right now but there was a good example showing a gallery of one word prompts with the same seed. While the images were of different subjects you could clearly see the impact of the noise controlling layout. What was was a capital letter A in one image was a persons legs in another, but that same overall structure was visible in the same place in 90% of the images
[ Parent | on HN ]