The point is that they're not fundamentally interconnected. The current line of thinking among transgendered people is that their sex is not appropriate for their gender, regardless of what the chromosomes say. I.e., their genital profile and secondary sex characteristics ("ovaries and testicles") do not exhibit the same sexual mode as their identity ("brain and pituitary", though in many cases likely just "brain").