If you don't allow downvoting of stories then you get this, so you have to ignore some stories. But that's much better than the alternative, which is people banding together to bury certain stories that reach the front page (or before they do, if the karma threshold is above 2).