I routinely handled beryllium for a couple of years as it is present in certain electronic RF power amplifiers. It’s perfectly safe in solid form. If you drill it or smash it, a different matter!

Plutonium, not so much.