I don't know what the effect was historically but right now if there's too many downvotes a comment gets greyed out. Furthermore you have to have over several hundred karma to be able to do it in the first place. In other words, the behaviour isn't symmetrical with upvoting, so I find it very uncomfortable, even for myself, to downvote merely for disagreement (i.e. the opposite of an upvote).