Why do we want comment scores?
Because we want to be able to pick out quality comments quicker.
What is broken with comment scores?
They have created a motivation for people to try and game the comment scores. A simple way to do this is by writing polarizing comments, or kicking up an emotional debate. This hurts the comment system.
So what is the root problem? Why do people want to game the comment scores?
The reason people want to game the comment scores is because the comment scores are tied to their identity. If you can find a way to tie comment scores to the comments, and disconnect them from the user's identity, there should no longer be a motivation for people to game the comment scores.
So how can we do this? Here are a couple of my ideas.
1) Kill the current karma system and replace it with some new system. Why? Since karma is tied to comment scores, people don't just get the instant gratification of seeing their comment get voted up. They get to keep those points as long as they have the account. When you log in you see your karma score right next to your name, just begging you to try and raise it.
OR
2) After 10 upvotes (or some other chosen value) start fading the username from grey to green, and immediately replace that user's name on the entire page with a randomly chosen tag. It could be Alpha, or Liono, or characters from the 30Rock, doesn't matter. As long as it isn't directly tied to that user's identity anymore. If you replace the user's name with the same randomly chosen tag, then readers will still be able to see that that person's comments come from the same person, they just won't know who it is.
All I know for sure is that if comment scores come back they can't be tied directly to the user's identity.
I do like the idea of dumping any visual notification of karma. The system could keep track for whatever things it needs to (minimum karma to vote, flag, etc), but there is really no reason for the community to know what that karma is.
IMO Removing karma won't improve the quality of the conversation.
Equally, anonymous, or pseudo-anonymous, comments give the commenter more freedom to make unhelpful comments.
Comments are tied to the identity, which goes at least some of the way towards them being self-moderated.
I still think the perceived reward of having high ranking comments has to be removed somehow.
What do you think bruce?
Karma should be displayed to the logged in user in a vague fashion: "Karma: good." The numeric score can be maintained on the server, but never displayed to the user. Downvotes and other abilities would simply show up one day when you've passed a certain threshold, but the user should have no idea how far along they are, as we're trying to dissuade the people that want those sorts of powers (and would abuse them) from getting them. Meanwhile, negative karma could start rate-limiting you past a certain point, such as only allowing 3 posts/day.
I'm still of the belief that the only way to ensure high quality discussion is to discourage commenting for it's own sake. Everybody does not need to contribute to every article, and having a numeric karma score only legitimizes posting for its own sake.
To reiterate my support for a previous point: the only way to fix the karma system is to kill the ego's involvement in it.
Simple systems, like the current karma system, can certainly be gamed, but with each iteration general value is lost. Displaying comment scores (which I prefer) can be abused. So that's gone, and a data point with it.
Keep them, don't keep them, I don't think I'll lose much sleep either way. But as a general rule, removing data or functionality from the many, to try and prevent the excesses of the few always invokes the ire of unit ended consequences. It's almost never an improvement.
-infinity to 0: bad comment, should be dimmed
1:
2-3: ★
4-9: ★★
9-27: ★★★
27-81: ★★★★
81-243: ★★★★★
etc. Though I think scores should be computed in a more sophisticated way than they are currently.That said, I don't think hiding scores is the only solution to this problem. I'd like to suggest an escape valve of sorts: If we accept that, from time to time, a bandwagon-bait comment will inevitably get voted up, we can consider a mechanism to deflate it. There is a simple way, to designate moderators who can demote these comments; then there is a more interesting way:
I hypothesize that there is an observable pattern to the votes over time of bait comments. It would be very interesting to see a comparison of highly-rated comments through a histogram: Is there a particular curve that insightful comments follow? Do bait comments have a signature spike at their tipping point? Can these be modeled in a straightforward way? The system could then be set up to slow, halt, or even reverse upvoting when a comment fits the model.
Just as long as you don't overdo it, or say anything too controversial.
IIRC, the comments I made that got the highest scores were accidental emotional rants that, more than embody some clever original insight, were in agreement with a large number of people. Usually the well reasoned ones get around 5. To get above that, I'd really have to play for the crowd, something I am not inclined to do. I value this place.
Also, I think we should switch it up so that comments are dimmed at more like -1 or -2. Otherwise, if the first vote is a downvote, people might overlook an otherwise decent (or controversial) comment.
This is needed. I'm constantly upvoting valid, neutral things even if I don't really have an opinion on them simply because their first vote was down, likely by a disgruntled parent post.
You've never been able to downvote replies to your own comments.
However, that is merely the method, and the idea of identifying quality stories is still sound.
People only need a general idea of the score for it to be informative of value.
Would that actually be better? Heck if I know. It'd certainly make grinding to 600 karma, so you can downvote people you disagree with, harder.[1]
1: Just kidding! Also, vi is better than emacs, and freebsd is quantifiably superior to linux.
This. ^ As someone pretty new to the HN community, I really feel like the idea in the above comment would make it easier to contribute my ideas and thoughts to a discussion.
Adding more contrast with the background helps pick out the good/important comments, when skimming, and is consistent with the semantics of text color fading. Although it would be even more consistent if the text color transitioned to something, I think it would look worse.
An additional option would be to adjust text color by downvotes and background by upvotes - this would also highlight controversial posts, which may or may not be desirable.
The point I'm trying to make, is that a score is more useful to someone using a plain text browser than a class attribute. Though there is nothing to stop you doing both.
This is exactly the wrong thinking and is why comments should be hidden. If that's what you do, you won't necessarily find the best comments, just the upvoted ones.
Here's a proposal: You can see the scores, but then you aren't allowed to vote in the thread. Maybe it can be implemented as you can see scores if you are not logged in. Then bandwagoning would have to be a deliberate act.
It fits my use cases which are skimming for good comments and figuring out if something I don't know much about has value (for example, if someone says, "they should have done it this way. . .", it can act as a barometer of the suggestion's value). It also seems like it would be easy enough to implement.
I'm not going to vote on the poll because I've actually found that the level of discussion has felt better without the votes shown. I enjoy the site more for the reason you've cited. Not to psycho-analyze too much, but the lack of vote scores removes the pressure to have the best comment or a better score than someone that has a different perspective. Even if two people are being totally respectful to start with, it can become psychologically difficult when the other person is getting more votes. One might try to make it a debate (that they're trying to win against the other person) more than a discussion (in which two parties are trying to figure out the truth together).
However, the site has become a bit less utilitarian and it sometimes does take me longer to weed through the information in the thread. Maybe varying the color of the usernames based on the comment score (and capping at 12) would add some limitations and fuzzyness to it that would meld the two. Capping at 12 would mean that both parties arguing might get the same public presentation of 00FF00 and that might quell the need for parties to prove that they're the winner of the argument by popular vote. Likewise, humans don't perceive colors exactly and that might add another layer that would diminish people comparing themselves so much and trying to score points. I guess I think it would be interesting to see if this would be a nice balance.
Example: A person posts that they think VPSs are better for hosting than renting a physical box and they talk about their reasoning (machine images that you can bring up more boxes of, launching new instances within minutes, whatnot) and it's a good comment. Someone replies espousing the virtues of physical hardware (a tad more speed, not sharing IO, whatnot). Now it becomes a bit of a competition between the two ideas (and the two posters). They were both good, valuable comments about different approaches. There is no right answer and there might not even be a better answer. The community knows this and both have comment scores above 12, but each person feels pressure to "win". With the green usernames, they're both at 00FF00 and have no idea if the community has given the other person more votes. There's no need to score points off each other or need to defend one's ego. You know you've made a valuable contribution and the other person has also, but for all you know they've gotten a good fewer votes than you. It still allows everyone reading the two comments to know that they're both generally good advice. So, there isn't a fight and an on-looker can see that both comments should be read and headed.