Well, yes, but if your plan to stop sexism is something along the lines of "Wait for jerks to suddenly become good people," you're doing a disservice to their victims.
> and silent bystanders to tell them so
I don't feel like it is my business to step in and speak for a woman who has not implicitly or explicitly asked me to do so. That seems like a really degrading viewpoint. If she clearly wants the guy to go away and he won't, yes, go up and help her. But the idea that it's my job to run around policing women's sexuality is just antediluvian.
Because you can't control the actions of others, but you can control your response to the actions of others. As much as any activity can be labelled taboo, humans are dynamic creatures and have the ability to break taboo at any moment, without any kind of notice.
> Isn't it the responsibility of the people making unprofessional advances to stop
Yes. But to suggest that is blue sky thinking. Isn't it the responsibility of criminals to stop criminal behavior? Why don't they?
> and silent bystanders to tell them so
Maybe. Bystanders don't have perfect insight into the victims mindset. What if a husband put his hand on his wifes knee? Should a noble bystander lay into the husband for his sexist behavior? Do you assume that every bystander is listening to every conversation within earshot, waiting for something to become inappropriate? Chances are, bystanders have their attention focused on other things, like the conference at large, or the people they are conversing with.
If a person makes it very vocally clear that they are being victimized, then yes, bystanders should do something. And thats the answer to your question as to "Why is it the responsibility of women to take the stand?"
It's about creating a positive environment. Of course there will be isolated incidents, but can we really resign ourselves to doing nothing?
I don't understand why you think this is not sexism.