Several caveats apply, chiefly that heavy elements weren't produced for a while in significant quantity, but were produced fairly early on due to large stars exploding relatively quickly, when they were merely tens of millions of years old, if that.
> In the redshift range 100 . (1 + z) . 137, the cosmic microwave background (CMB) had a temperature of 273–373 K (0-100◦C), allowing early rocky planets (if any existed) to have liquid water chemistry on their surface and be habitable, irrespective of their distance from a star.
> In the standard ΛCDM cosmology, the first star-forming halos within our Hubble volume started collapsing at these redshifts,allowing the chemistry of life to possibly begin when the Universe was merely 10–17 million years old.
From: The Habitable Epoch of the Early Universe - https://arxiv.org/abs/1312.0613
In comparison, our beloved sun is estimated to have been born 9.2 billion years after the Big Bang, a third of the way into the universe's history so far.
> The Sun is approximately 4.6 billion years old, while the age of the universe, based on current estimates, is about 13.8 billion years.
So our solar system is not that old, relatively speaking. We're among elders, some stars are three times older than the sun.
> In the future, however, life might continue to emerge on planets orbiting dwarf stars, like our nearest neighbor, Proxima Centauri, which will endure hundreds of times longer than the sun’s.
> Ultimately, it would be desirable for humanity to relocate to a habitable planet around a dwarf star like Proxima Centauri b, where it could keep itself warm near a natural nuclear furnace for up to 10 trillion years into the future.