It's probably an ancient survival mechanism. If you eat the food nobody else wants you have better chances of survival.

That's how "acquired tastes" develop physiologically and culture takes care of passing it down the generations.