I believe your observation is correct. I'll also throw out a possible reason for women being less okay with sexualisation in conversation: We're the target or object of sexualisation far more often than men are, and sometimes in quite threatening contexts. If you keep getting exposed to something in a negative context, you stop liking even fairly mild occurrences of it. (I'm sure a black person hearing even quite mildly racist jokes will be more annoyed than a white person would, because they are usually the target of these jokes.)