I think audiophiles don't have any meta-perception of how their own cognitive process colors sensory information, while somehow being able to map the difference in aural space.

So maybe in a sense it does "sound" different, but it's more because what they are thinking about leaks into their aural experience.