It doesn't move anything, but it does mean that things that are now far away used to be closer, and therefore had the ability to affect us, but now don't.

Not that it matters, because the speed of light is still the limit: if they could influence us when they were closer, that would have happened by now.