Mate, no. This applies to men, women, nonbinary folks, non-human animals, etc. Literally any living thing. If you don't consent, anyone having sex with you is wrong. It's wrong if a man tries to have sex with a drunk, non-consenting person, and it's wrong if a women tries to have sex with a drunk, non-consenting person.

This is the _opposite_ of making a decision for someone. It's recognizing that they kind of _can't_ make a decision, so you simply do nothing.