Many employees are not comfortable with the accommodations for trans colleagues required of them by their employer (and by our current legal environment). Those employees don't really have a means to have their concerns addressed: it is either comply or quit/get fired. A way around that is to simply avoid hiring trans people.
That you do not understand those concerns does mean they are not understandable.
It's a bit more complicated than that.
I have nothing against trans people. I see them as just people trying to get by, as everyone else.
But having them in the workplace is frightening. Wronging them with perceived micro-aggression can be extremely damaging to one's career. If such an event gains publicity, it may be a scarlet letter on yourself for future employment.
My only solution to this is to leave. Just throw some CVs around and land a new job.
Remote work in this regard is a blessing. You don't have to interact in person anymore. Just use their pronouns in written communication and focus on your job (works great when you are an IC).