> There seems to be some sort of ingrained biological threshold for what is a compatible mate and what isn't.

Perhaps in a general sense yes, but across millions of people across tens of thousands of years, there will always be outliers who'll mate with anything with two legs.