This is of course not the case with the demands of men who desire to be women and women who want to be men.
What about the women who are really butch? Or the effeminate men? Would you want them excluded too, or would a genital inspection be considered sufficient to qualify them?
This has been used to rewrite law and policy so that any man who claims he's a woman can, with impunity, impose himself upon spaces that were only ever intended for women and girls.
That's a huge change and has significant impact on the female half of the population, wouldn't you agree?
The military policy (that I assume you're defending) is to ban anyone with a "history of gender dysphoria". Your points would have a little more weight if the situation was like in 2018 when individuals could serve under the condition of being stable for 18 months in their identified or assigned gender. But not much more weight, since that is still a lot weaker than what you describe.
Looking at your link, I can see how the conditions specified there would make someone less effective as a soldier. I can't say the same for gender dysphoria.