You might be able to wave your hands and claim that the time machine follows paths back in time along natural world-lines in curved space-time (gravitational geodesics), which will at least get things like orbiting around the Sun right (and galactic motion as well). But I think you'd still need some way to keep the machine's path rotating on the surface of the Earth rather than falling back and forth through the center of the planet.
Unless you're considering a model of time travel where you're still literally in the same room and just living in reverse (while still visible to all the forward-living people around you and interacting with them as you go), this isn't equivalent to CP symmetry reflection.
Most time machine ideas instead picture some sort of wormhole or "stitching" between different points in space-time, in such a way that the local "forward time direction" remains continuous for observers taking the trip (and then connects back up with forward-directed time at some point in the past).
(I'm teaching a low-level course on "Time Travel in Science and Literature" this term. It's fun, but a challenge without using math.)
If you mean "you go wherever inertia would take you in that amount of time, with no acceleration", then if you go backwards a multiple of a year you end up pretty close to Earth (quick approximation: the Sun's acceleration in its orbit in the milky way is ~2*10^-10m/s/s, which works out to ~100km in a year, ~400km in two years, etc.). In actuality you could probably get somewhat better range by letting your velocity build up to intercept Earth-that-was at the target time. (You'd need to take into account a bunch of things for best accuracy: the Earth's orbit is not "perfect", the moon's phase, the acceleration of the Sun, etc, but we know most of that.)
You probably would end up needing to make multiple jumps, pausing in-between to let Earth's (or another planet's, or even the Sun's) gravity well readjust your velocity to what is needed for your next jump.
This means that you'd need to build in re-entry capability into the machine (as you are unlikely to have the precision necessary to be able to jump into atmosphere at a sane velocity), and potentially maneuvering delta-v. Note that with a time machine you lose conservation of momentum, which makes things a lot easier. You can change the direction of your velocity vector by jumping back in time and interacting with your past self. You can potentially use this to get "free" (read: reactionless) velocity out of any gravity well.
EDIT: Right, not really part of the plot. I just think I remember him (in the commentary) talking about some of the "trickier" aspects of writing a story about time travel, and I think he mentioned the fact that nobody ever really addresses the positional aspect.
If I recall correctly, you'd turn on the machine, wait N hours, go inside the machine, and in the next N hours you'd be going back in time and come out the other end at the moment the machine was turned on. So you would have spent 2*N extra hours, the machine would have always been in the same spot, so there'd be no problem with traveling through space.
There are still problems with the paradoxes, but that's part of the plot of the movie.
Relativity is weird.
Earth Center? Solar Center? Galaxy Center? ... Universe Center?
hmm traveling backwards along the 4th dimension by itself sounds like we are NOT traveling in the other 3.... so where would the atoms (that originated from your banana at 9:25am 3 days ago) go if we merely changed their value on the 4th axis? does their xyz stay locked at the current values or revert back to their previous values.
Where we are in the universe today is very far from where we were in the universe yesterday based on the movement of the earth alone. Add to that the movement of our solar system, galaxy, cluster, supercluster and movements I am not even aware exist and it becomes really far away. Grandpa would probably be light years away from me and my time machine.
Am I missing something here, because I've never heard this mentioned by anyone else?