At least for allergens, the latest advice is that babies should be exposed to them because early exposure helps prevent food allergies.

Your experience might simply reflect that anyone on a careful diet is likely to be healthier than average simply by avoiding all the junk people typically eat.