I can understand a downvote with a solid reply, but downvote just for disagreeing doesn't add to the discussion, its more of a censorship which should only be used for offensive/misleading comments IMHO.

Personally, I use upvotes to reward new knowledge or an interesting argument in a comment, I don't upvote every comment I agree with, and downvote only if the comment is offensive.