Sometimes i had a 5-10% ping loss between servers in the same Hetzner datacenter, so not being on the same rack can be a problem. Especially if you are using nginx -> backend. Then every request is a TCP connect to the backend server, and when SYN packet is lost, you will have a 3 seconds timeout (at least on FreeBSD TCP stack).