In my experience, looks matter to men a lot more than they matter to women. Of course some level of attraction is necessary but (again in my limited experience) women are far more willing to go for an average-looking partner with a great personality than men are.