Primates also eat fermented fruits which have enzymes that convert to something more digestible. By going for the cleanest best looking fruits/foods we have decreased the diversity of our gut bacteria which increasing the things people are allergic to.