The biggest group likely to be impacted is trans people, not intersex people.
Trans people have been around forever, and aren't going away just to make image classification less complex. It's not a "trend", treatment options just happen to be more available and the internet makes communities more visible now.
So the solution would be to not identify _anyone_ as people? As a ginger I doubt that.
https://adssettings.google.com/u/0/authenticated
Here Google can infer my gender and my age and personal interests just from my search history. I am sure this is not perfect either, it is still immensely useful for advertising.
Humans don't have much trouble, except against adversarial/outlier examples.
Now, 0.6% of Americans identify as transgender [http://williamsinstitute.law.ucla.edu/wp-content/uploads/How...]. That means using sex prediction alone, we can achieve a theoretical maximum of 99.4% accuracy here. This ignores the fact that transgenders often signal their gender via behavior or clothing, or attempt to obtain the physical characteristics of their assumed genders as well, both of which could further improve performance.
Loads of research suggests 7 year olds are about 70% accurate at predicting gender based off of pictures. It takes a couple of decades to get that into ranges you’ve cited. That doesn’t sound easy. If it is, I’d love to read about it.
Why be toxic?
The fact is gender can be determined by appearance in 99.5% of circumstances or more, which is probably higher than the overall accuracy of their ML labelling system.
The idea of "avoiding unfair bias" is highly vague and problematic since, theoretically nearly any statement or view beyond "particle X is at Y" type statements has a somewhat "unfair" bias reflecting the lens of the human experience, which has developed over millions of years of biology and thousands of years of culture.
Finally, seeing as the fact is that 99% of people would not be negatively affected by this feature remaining whatsoever, and the very slight negative impact on the other (intersex type) 1% or so is minimal at best, while the total impact of removing the feature is mildly annoying for many users, this seems a lot like irrational, hollow, virtue signalling.