The problem for women is that the negative societal aspects of their lives are not controlled by women - it's still largely controlled by men. Same for people of color in the US - their lives are largely controlled by white people (and specifically white men).
I think even for the wildest of misogynists out there (I am in no way implying this is you or anyone on HN) it's hard to argue that the world would not be drastically different if it was mostly controlled by women.
You're making an implication without saying it for some reason, so excuse me if I'm misinterpreting, but it wouldn't be hypocritical to think a "day" is more appropriate for one group and less appropriate for another, regardless of the metric used for definition. Men and women are different. Everybody is different.
That said, I have no problem with the concept of a men's day.