I think if the amount of downvotes someone could cast in a given 24 hour period were limited to some smallish number, perhaps 5 or 10, then some people might save their downvotes for the comments that that really detract from the tone of the discussion.