I think it’s more about uncanniness and some sort of latent, subliminal incoherence. Like maybe it is somehow disruptive to visual memory in a subtle but noisy way, because it doesn’t hang together quite right.

I have no science to back this up, mind you. But I struggle to recall details of these images (I also believe I have a limited form of aphantasia so it could just be my flawend noggin)

But I will take your point ;-)