Practiced musicians begin to feel discrepancies in time starting at latencies as low as 10ms. I learned this when investigating whether bands could practice live over the internet (spoiler: most of them can't). Turns out that due to limitations of physics, even absolutely optimal connections still have enough lag/jitter to ruin it for professional instrumentalists.