It's not about background radiation level. It's about the risk of ingesting or inhaling a speck of radioactive material. If this particle settles somewhere in your body, it means that the cells in the immediate vicinity of this particle are going to subjected to very intense radiation.