That's a tempting argument, but I agree with pukka_my. Sexual jokes or innuendo make some people, especially women, uncomfortable. Among friends, in private, you might know that everyone present is fine with that kind of banter. In a public place, you can't know that. So giving yourself permission to make such cracks anyway is at best insensitive and, if repeated, betrays an attitude that says "because I'm a man and you're a woman, I don't have to care how you feel about this". That's sexist.