"People irrationally hate X" may be perfectly true, but is not a reason why any particular, or most, or the most significant, criticisms of X are wrong or should be ignored.

Even the particular people who irrationally hate something are obviously likely to also run across the good reasons for hating it.

It's not reasonable to say "criticism X doesn't count anymore because we've heard it too many times".