Visual design is a key, integral part of "look and feel" and usability. I would argue that even if you ask your users and they tell you they don't care about the aesthetics, they actually are influenced at some level by them. People (including me) are more likely to continue to use and contribute to a well-designed and attractive site.