Sometimes who you are, a physical trait, an accent, an unrelated disability is a "distraction". And, yes, personality and neurological traits can count as well.

I can understand "don't be a jerk", and maybe RMS failed that test. But "don't be a distraction" can easily be (and has been) an excuse to oppress in the name of pragmatism.