This is indeed what will happen, you will arrive at Earth finding the planet and the people much older than yourself. (It can be by years or by millions of years, depending on speed and duration of travel.)

If you wish to call that time travel, you may. I guess people just reserve the term "time travel" for travel backwards in time, since that is so much cooler.