Well, neutron bombardment from fusion means you get some radioactive isotopes. It's not as bad as spent fuel but still something to avoid.

But that doesn't really matter. This is expensive technology you don't want to blow up. Yes, more expensive than rockets.