> Personally I don't have a strong opinion on this, especially since trans women taking over women's sports is not a problem yet anyway.

It is a problem - see https://shewon.org for an increasingly long list of actual women who have been pushed out of winning spots in their sports by men who identify as women.