I have worked with a lot of people with Asperger's over several years, I don't recall anyone but neurotypicals being rude to me.

While I'm sure there are rude people with Asperger's out there, rude neurotypicals can potentially be damaging in a far more efficient manner by knowing how to twist the social norms to give the pretence of staying within their boundaries.