It isn't intended as a personal attack. But I think the distinction matters. If everything is done for the sake of what men want and what women want has zero role in the debate, ultimately, it doesn't really matter what conclusion is drawn. It will still harm women.
There's no need to play amateur psychologist in policy debates. You can make your argument without attacking someone.