The end of eternity by Issac Asimov touches on this. I believe the analogy is that of a bird being left behind by earth as it flies through the air because earth is moving through space. So as you travel through time you move in time with whatever it is you're traveling on, I guess is the argument the book makes.