I'm not so sure about your conclusion there. The galaxy is around 100k light years across. Seems like a lot, but the Orion project looked like it could potentially reach speeds of 10% the speed of light. Even assuming that's optimistic, and it could only get to 1% the speed of light on average, that's just ten million years.