I have the same gut feeling about dairy. I think we humans are the only specie that drink milk from other animals (not 100% sure about that) and you don't have to be lactose intolerant, you can also be allergic to milk protein(s). And we might be the only specie that drinks milk in adulthood too.