I think hacker news does an ok job at mitigating this by not allowing you to downvote until you reach a certain amount of karma.

Obviously that creates its own problems but at least you have to have a little bit invested in the community before you can start trying to dictate the conversation.