Frankly, I want to have a choice if I go to such a conference to concern myself with topics that interest me. Maybe some other time I'll go to a conference about women's rights. At any milliseconds there are a zillion unfair things going on in the world, we can not deal with them all.
In this particular situation, for example, I wouldn't see anybody who was hurt directly. Like if I saw somebody beating up somebody else on stage, I might be moved to step in and stop the beating. But here - even if some women's feelings were hurt, I figure they could just leave the room without my assistance. So it doesn't seem worth the trouble to make a fuss about it.
Sure, you never see it... that's makes it easy to pretend it's not happening. But anyone with eyes below your nose level (most likely women) definitely sees it.
And your only defense is developing good rapport with those people, and giving them reason to believe that you'll respond graciously when they point it out.
Everybody faces prejudice. For example I face prejudice because I work with computers. I don't think that warrants inflicting a huge guilt trip on the rest of the world.
To be sure there are probably circles of men who think it is cool to insult women. Likewise there are circles of women who think it is cool to insult men. That doesn't generalize to the whole population, though. For example, I am male and I don't think it is cool to insult women. Why don't you generalize from me to the whole male population of planet earth, rather than generalizing from some bonehead?
There are all sorts of fucked up people, in fact. To generalize from them is just useless.
If I had been to that particular talk, I would just have made a mental note to avoid that speaker in the future. I probably would have left early, too - what is the point in sitting through a crappy presentation? Maybe even send a note to the organizers so that they can adjust their speaker line up for the next conference.