I imagine growing spores with the knowledge that you can grow mushrooms that can be used for psychedelics from them is similarly illegal to buying/growing poppy flowers knowing that they can be used for opium.

It's only legal if you don't know -- a thought crime