Too few chromosome types. And you need to factor in testosterone insensitivity syndrome where the chromosomes won't be easy to tell from the outside. And the situation of the people in the original article. And brain dimorphism. And other phenotypic and genotypic variation. Sex is quite complex.

Also, if an individual, for good or ill, cannot be trusted to make the permanent decisions about their body - who can?