Yeah. It would work like video game rankings. Top-ranked players are top-ranked because of skill, and if they happen to be mostly men for most games, so be it.

But I get your point. The crux of the problem is most people don't want to see skill-based matchmaking. They want to see the best man, the best woman, or the best disabled person, etc. The categories are already defined in people's minds as cultural constants. The trans people don't like this because they feel excluded by both male and female categories, so they argue in bad faith that there's no physical difference between females and trans-females or males and trans-males. Our long-term options as a society are to either 1) change culture so that people get used to skill-based matchmaking like in video games, or 2) ignore trans people and wait for this issue to disappear when future tech allows a man to transfer his consciousness into a female body and vice versa.

Since 2) is quite far out technologically, I propose 1).