Image Diffusion Models Exhibit Emergent Temporal Propagation in Videos

Re:Image Diffusion Models Exhibit Emergent Temporal Propagat... by echelon on Wednesday November 26, 2025 @06:16AM (#46056297)

All of these emergent properties of image and video models leads me to believe that evolution of animal intelligence around motility and visually understanding the physical environment might be "easy" relative to other "hard steps".

The more complex that an eye gets, the more the brain evolves not just the physics and chemistry of optics, but also rich feature sets about predator/prey labels, tracking, movement, self-localization, distance, etc.

These might not be separate things. These things might just come "for free".

[ Parent | on HN ]

Re:Image Diffusion Models Exhibit Emergent Temporal Propagat... by jacquesm on Wednesday November 26, 2025 @07:25AM (#46056752)

There is a massive amount of pre-processing already done in the retina itself and in the LGN:

https://en.wikipedia.org/wiki/Lateral_geniculate_nucleus

So the brain does not necessarily receive 'raw' images to process to begin with, there is already a lot of high level data extracted at that point such as optical flow to detect moving objects.

[ Parent | on HN ]

Re:Image Diffusion Models Exhibit Emergent Temporal Propagat... by Mkengin on Wednesday November 26, 2025 @08:05AM (#46057003)

Interesting. So similar to the vision encoder + projector in VLMs?

[ Parent | on HN ]

Re:Image Diffusion Models Exhibit Emergent Temporal Propagat... by DrierCycle on Wednesday November 26, 2025 @08:34AM (#46057247)

And the occipital is developed around extraordinary levels of image separation, broken down into tiny areas of the input, scattered and woven for details of motion, gradient, contrast, etc.

[ Parent | on HN ]

Re:Image Diffusion Models Exhibit Emergent Temporal Propagat... by fxtentacle on Wednesday November 26, 2025 @07:14AM (#46056685)

I wouldn't call these properties "emergent".

If you train a system to memorize A-B pairs and then you normally use it to find B when given A, then it's not surprising that finding A when given B also works, because you trained it in an almost symmetrical fashion on A-B pairs, which are, obviously, also B-A pairs.

[ Parent | on HN ]