I don't think we have any examples of people being neurodivergent in a way that is purely positive, so every instance would likely be some sort of disorder.

Plenty of neurotypical people can't handle certain situations. IMHO, neurodivergency can be the same, it's just that the situations that they can't handle can happen to be situations that are expected by society, so they're automatically disordered. Plenty of neurodivergent people have found a way to function in society, they just can't all do it the exact same way as neurotypicals.

Of course you're not wrong that it's likely to come with disorder anyway, since for example the autism spectrum has all sorts of possible symptoms, like being unable to learn how to speak fluently, or at all. It's hard to argue that not being a disorder, just in terms of it being an unnecessary impairment and not just a difference in specialization.