In this light, there's no need to single out nerds/intellectuals/whatevers. We can just say that cultivating an active disinterest to isolate yourself from others is generally a bad thing.
At the end of the day, people will like what they want. They will dislike what they want, too. Whether that is because of a valid reason, or whatever silly notion of not wanting to fit in, or anything else is irrelevant.
The point of the post is that motivation is relevant. Some people don't want to be elitist; it bothers me. If they apply some introspection to their motivations, they may discover this behavior describes them, and they may want to change. What people "want" is not some inherent immutable trait of their humanity. Sometimes what people "want" is a result of cultural expectations.