There are two types of radioactive material: A, stuff that radiates very little but lasts very long. And B, stuff that radiates very much, but lasts only some months.
If you are concerned about stuff A, like uranium. There's plenty in nature. It is dangerous already because it emits Radon gas. People still live with that. But you really need large quantities for it to be dangerous.
Nuclear power plants need surprisingly small quantities of fuel. And that doesn't turn into large quantities of waste.
"In contrast, the amount of natural uranium required to provide the same amount of energy as 16 kg of fossil fuels, in a standard fission reactor, is 2 grams; and the resulting waste weighs one quarter of a gram."
http://www.inference.phy.cam.ac.uk/withouthotair/c24/page_16...
Turning to nuclear power means that we will have more waste to deal with - and more risks for the future of human-kind. I have no idea what society will look like in just 200 years, but it feels dangerous to be storing up these issues for them to deal with. (I have the same concerns about rampant fossil fuel use).
Yes in the short term nuclear power can also have a 'boogie man' affect, but that shouldn't take away from the concerns that many, who are wary of nuclear power, have for the future.