Once you scale up to gas giants these factors become even more important. Those planets retain a crap ton of heat from their initial formation and are comparatively inefficient at radiating it away into space. More so, they continue to generate heat through ongoing settling (raining of Helium down to lower levels of the atmosphere, for example).
I am barely qualified to call myself even an amateur astronomer, so sorry if I've misinterpreted anything.
edit: re-reading the passage, it sounds like it's a combination of both (bottom of p.245, 246).
Different kinds of radiation differ by how deep they penetrate matter. Simplifying a bit you can imagine that for every atom the radiation passes, there's a probability that it interacts / gets absorbed.
Radiation that passes thousands of kilometres of rock without interaction will have a rather low probability of interacting with a mere metre (or so) of human.
Before the discovery of radioactivity invalidated the calculation, the fact that the Earth's interior is still hot was used by Lord Kelvin to set an upper limit of 40 million years for the Earth's age.