Latency is the whole chain. That's Linux's latency, on top of everything else that could be there, such as however many meters of distance between speakers and listener in a live performance.

In no way is it acceptable for Linux to add 5ms to the chain.