Except it’s absolutely not if managed appropriately.

If they’re behaving that way unannounced then yeah, it’s not good but if the manager is aware then all that’s needed is “hey team, Andy is on the spectrum and prefers to work this way. Please try to accommodate, any issues let me know”

Those requirements aren’t challenging to meet for a coworker.