It's plausible, but I think the experience thus far is any dust in the lungs is a health risk. Asbestos will not be soon forgotten.

I'd be more worried about testing phosphogypsum's mechanical properties before anyone starts testing the radioactive ones. And danger relative to tyre rubber; although that has probably already been studied somewhere since it is an obvious thing to check.