No, there was a time that all space was hot, and we know from microwave background radiation that it is homogenous. So it’s not just “galaxies are far from each other”, it would take “space time is discontinuous somewhere and this discontinuity is just on the edge of our observable universe”. There is also no older light that can ever reach us, as the amount of universe that is observable is actually decreasing (beyond that, CMB will always be the oldest light as it predates any astronomical object formation). Anyways, CMB really constraints the age/homogeneity of the early universe.