We do integrate the delay between us and a speaker some distance away in the sensory experience, yes, but this does not mean that the sensation of a shorter delay is imperceptible. It can be tested: Room simulator, playing the instrument as if it were 10 feet away, change the latency around.