Well, that's a bit of a false dichotomy. Disliking prejudice doesn't mean I don't wish RMS was a better spokesperson.

But I wasn't really taking about the people who take him less seriously, but those who use that as an argument in a discussion. The former is a flaw (from which I suffer too), but the latter is much worse.