Earth has had lifeforms for about 90% of its existence. Earth has existed for 33% of the age of the universe. The time it took organisms from Earth from the earliest lifeforms to discovering space travel amounts to 30% of all time was available in this universe.

Sure, it's easy to imagine someone doing it a million years faster than us. But at the same time it's very likely we are just early to the party.