People travelled, but regular people didn't routinely travel to the other side of the empire. The road network was probably used more for "local travel" than "far travel".