I’m sorry, but an all-male lineup really is not so great. It may not be literally ‘inexcusable’, but it’s pretty damn close. When you then get a hostile response that doesn’t even attempt to excuse (maybe there is a valid excuse of some sort), then that behavior is literally inexcusable.
Yes, I do expect conference organizers to put extra effort into making sure the lineup is at least somewhat balanced. Just not being actively sexist (by, say, denying qualified female speakers) is most certainly not enough. When an all-male lineup is the result of their normal process then I do expect organizers to go the extra mile, looking for qualified female speakers. That’s all, and it’s really not that much to expect.
I expect no one to relax their criteria for selection, but I do expect people to search harder. I think that’s very much needed.
Edit: Just want to clarify that I think diversity in this field is a huge problem, and I care a lot about it, but the author's tone (he was immediately critical of organizers who may be innocent) and suggestion did not sit well with me.