He’s being against against it because people are currently using the term, saying they are against it, and then making medical decision that hurt people based on that.

This is what he is against. Unnecessary harm due to people worrying about the supposed nonsense of the term.