Cinnamon, nutmeg, mace, star anise, ginger, and real pepper all contain small amounts of safrole (the actual chemical) as well. It would be ridiculous to propose banning herbs and spices due to naturally-occurring safrole.
I imagine it has to do with the quantity. And the FDA did indeed ban it:
https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfcfr/cfr...
I thought culinary use was technically not legal due to cancer concerns. The leaves can also be psychoactive.