Neither is wearing skirts or dresses. Some men wear them happily by choice, but it’s still seen predominantly as an expression of femininity. Social and legal rules aren’t built to be true without exception. Once as a thought experiment I tried to determine what characteristics you could use to say unequivocally someone is male or female and it proved to be impossible. There is an exception to everything, so it’s best just to ask or be told.