Oh, that's just because you are reading 'neurodiverse' literally. The usage here tells you that it's obviously a euphemism for a term that doesn't have the problem you describe.