I think it's the intermodalation distortion or as I call it "the room sound" that your non-conscious mind perceives. The best example of this I've heard is when listening to identical masters on SACD/DSD vs PCM audio. Notably different sound when reproduced via loudspeakers.