So you are automatically assuming men are the offenders. This is very much a constructed prejudice. Did you ever consider that men want men-only spaces to avoid being accused and talked down to? While I never visited a mens only place, I totally understand why that would be the rule at some of them.