> feminist advocates and not gotten a bit of static because the context they were used in was perfectly clear and not avowedly harmful
Do they even have the right to complain? You use whatever language you want, and they can choose whether or not to hang out with you. "He's boring to talk to, all he wants to talk about is Yankees baseball". Any allegation of misogyny these days or even worse, sexual misconduct will ruin the life of a man. Even if he managed to clear himself of criminal wrongdoing, his career is over.
Heck, Derrick Rose's accuser didn't even have her name made public whereas Derrick Rose had his name dragged through the mud and had to spend plenty of time and money on lawyers. Whatever happened to the legal system being public record?
That's the best case scenario. The woman was trying to settle, but ended up trying to sue for 21 million. Again, that is the best case scenario, that you have enough time and resources to lawyer up.
If somebody accuses you of something like that when you're at work, there is no due process when it comes to HR. You can sue for wrongful termination, but that's hard to prove and requires expensive lawyers.
The latter--I've used very similar phrasing in conversations with feminist advocates and not gotten a bit of static because the context they were used in was perfectly clear and not avowedly harmful, as per your first example. I think you're misunderstanding the objections that would be raised about your speech.