I recently thought that it might be an interesting experiment to not display any vote counts but instead order the posts based on them (as already done I guess).
pg did this for a few hours and used circles where the point number one, something like orange or red color was used to denote a popular comment.
Many people disliked this however and decided that the numbered system was better, thought a few hours allows very little benefits to be seen.
Unless a comment is offensive or distracting the conversation, take it easy with the downvotes people.
</meta>