That's not latency, though. There is zero delay between the musician initiating an action and sound happening. What you're talking about is the transients or attack at the beginning of a note and those are a profoundly important part of the sound.