If I installed a really bright light source on two opposite ends of the observable universe and timed everything correctly, I could make it seems like the point traveled across the universe in a fraction of a second. Same idea, same flawed logic. Nothing actually moved.