If something is 99.9999999% safe, it's not going to have a catastrophic failure. It will have some rare minor failures, whose effects are mitigated by a cascade of multiple safeguards.

> Our current strategies include finding a secret underground cave

Let's ignore how radioactive minerals are already found in caves.

Just don't ventilate your above-ground cave, and you've got radon gas.