With any other hard physical science, the math is derivable. I can look at the equations for special relativity, I can read about the aether-related theories that preceded it (which were consensus at the time), I can see where they fell short and how they failed to measure up, I can read about Einstein's thought experiments that the led to the theory, I can read about the fundamental experiments that validated the theory. I can see how it evolved since then and led to developments in quantum physics. I can do all this. And I submit to you that if quantum physics is accessible then certainly climate science and geology are accessible. We have Google Scholar, ScienceDirect, numerous sources for contemporary publications and you can absolutely follow it and you can play a part in it. And then you will know the topic.
I outsource thinking to other people all the time. That's essentially what it means to live in a modern society.