How is this different from booing you for saying something stupid/wrong (or otherwise disliked even when smart/true) in a public venue. If anything, downvoting seems more honest and less "censorish" than booing, because you still get a chance to respond.