That is not at all necessarily true. We have another 5 billion years or so before the sun exhausts it's hydrogen and starts substantially changing.

Applying even current levels of intelligence and knowledge (nevermind projecting even hints of the growth rates over the last ~10K years since agriculture, writing, etc. started), that is more than sufficient to develop resources for interplanetary and interstellar travel.