Yeah, apparently downvotes can be used as a "disagree" signal. Usually when I see a comment being unfairly downvoted that way, I upvote as a counter-balance, even if I disagree with the argument (i.e., how many bytes in 1kB).