Re:Smartphone screens are about to become speakers
by nonrandomstring on Monday February 12, 2024 @10:19AM
(#39345743)
> This perceptual dissonance
Check out Michel Chion and the idea of the "audio-visual contract" [0]
I forget, but it has a more formal definition like source fusing in
experimental perceptual psychology.
What happens is there is a brief dissonance, but it only lasts for a
few milliseconds and then our brains _very_ quickly adjust to align
what we see and hear, and crucially what we attribute as the source of
sounds. This is a actually not a learned but a low-level adaptation
because sound travels slowly compared to light and it reflects (echos)
so our brains must be able to re-synchronise effortlessly.
Check out Michel Chion and the idea of the "audio-visual contract" [0]
I forget, but it has a more formal definition like source fusing in experimental perceptual psychology.
What happens is there is a brief dissonance, but it only lasts for a few milliseconds and then our brains _very_ quickly adjust to align what we see and hear, and crucially what we attribute as the source of sounds. This is a actually not a learned but a low-level adaptation because sound travels slowly compared to light and it reflects (echos) so our brains must be able to re-synchronise effortlessly.
[0] http://www.filmsound.org/chion/av-contr.htm