Of course it makes more sense to colonize at least one other planet in our solar system first to learn on a smaller scale with lower stakes. But waiting for entirely new physics is unessesary.
https://io9.gizmodo.com/how-self-replicating-spacecraft-coul...
https://www.open.edu/openlearn/science-maths-technology/scie...
What's this mania you have of disseminating yourself? Even if you build ships that carry human genes sequences and send them on a million years trip, who is going to benefit? The sequences you sent?
Life. It's what living beings do. If some group of living beings stop doing it, there are fewer of them, later.
I’m told there was a book on this exact topic. I’ve never read it, because other people tell me it’s now wildly out of date.
We could also colonize objects in the Oort Cloud, just gradually hopping outward from rock to rock, with fusion to power our little colonies, ultimately reaching interstellar distances. It'd be a little slower, but it'd happen without any special effort.