my pet theory is that galaxies are more like fireworks wheels, and so we aren't strictly orbiting the galactic center, we're also slowly getting farther and farther from it (that also takes care of the dark matter conundrum in my view), and thus couple billions of years ago we were in the much better and more populated part of the town than the current 'burbs.