That’s not it at all. What people are saying is that attractiveness is subjective, and nobody’s preferences are more or less valid than others’. Where people get into trouble is when they start making blanket statement that the world does / should operate according to their preferences, at which point people who prefer differently start rolling their eyes.

It’s not acknowledging differences that are the problem. It is things like the assignment of value judgements and other stuff that people erroneously attribute to those differences.