As someone who dislikes the “you’re holding it wrong” argument, I don’t think that’s what’s happening here. Your network latency is outside of Apple’s control.