I always had the impression that psilocybin in particular either was not tested for or does not stay in your body long enough to be tested for. My only concern with psilocybin mushrooms would be their legality, but IIRC, it is not illegal to possess spores for them.