I think people get way too bothered about downvotes (myself included). They affect nothing other than color. If someone disagrees with you, good. It means you've taken a stand on something.