So doesn't critical thinking in fact have to have a baseline in something other than one's own direct experience? Rationality, possibly?
Evidence for the big bang ultimately comes from sense data. You have to integrate a lot of sense data into scientific theories, which then are integrated with other scientific theories, and so on. Science has gotten so far - but it all started out with simple experiments, eventually microscopes and weak telescopes, etc. and built from there.
Critical thinking allows you to overcome cognitive biases. Faulty perception is pretty easy to detect. A stick in a glass of water will look bent, but it's easy to figure out that it actually isn't bent.
By that reasoning, all the people who deny the moon landings happened are completely logical, no? And there should be a lot more of them, right? Hell, I've never even seen a rocket take off (outside of video broadcasts), let alone seen spacecraft in flight, so I shouldn't believe in the moon landings either, right?
If I hadn't seen airplanes and flown in them, I'd still be open to believing they exist. My belief would depend on what other evidence there is (broadly speaking), as in my example of the moon landings.
It's easier to make a strong judgment about the existence of airplanes, than about the moon landings. I'd argue that most things in life are more like airplanes in that regard.
For example, I probably wouldn't 100% believe that hundreds of people can cross the sky in a metal tube (i.e., modern jet airplane) if I had only been told about it. But I've seen it myself.
Another example: I've learned enough about technology to think the moon landings were feasible, and I've learned enough about society to think that a successful conspiracy around the moon landings is implausible. So I believe the moon landings happened.