That, and the inability to change a vote. There are many times I've hit the down arrow when I meant to hit the up arrow. After just one downvote, the comment starts to turn grey, which leads to more downvotes.