News for hackers. Stuff that matters.
Re:Poll: Should HN display comment scores? by mdasen on Saturday May 28, 2011 @10:02PM (#2595707)
This wasn't my idea (someone else had posted it), but I think it would be nice to see the usernames fade from grey to green as the comment score increases (maybe capping at 10 or 15). That way, one can quickly scan and see the best comments, but there isn't such a direct relationship as a numerical score. For example, the username could go through these steps:

  004400
  005500
  006600
  . . .
  00EE00
  00FF00
That way one can even faster pick out things that people have generally agreed is of good value, but it isn't immediately obvious what the exact score is - there's a fuzzyness to it - and there's also a cap on the displayed score (in that you can't get more green than 00FF00 and starting at 004400 would cap it at 12).

It fits my use cases which are skimming for good comments and figuring out if something I don't know much about has value (for example, if someone says, "they should have done it this way. . .", it can act as a barometer of the suggestion's value). It also seems like it would be easy enough to implement.

I'm not going to vote on the poll because I've actually found that the level of discussion has felt better without the votes shown. I enjoy the site more for the reason you've cited. Not to psycho-analyze too much, but the lack of vote scores removes the pressure to have the best comment or a better score than someone that has a different perspective. Even if two people are being totally respectful to start with, it can become psychologically difficult when the other person is getting more votes. One might try to make it a debate (that they're trying to win against the other person) more than a discussion (in which two parties are trying to figure out the truth together).

However, the site has become a bit less utilitarian and it sometimes does take me longer to weed through the information in the thread. Maybe varying the color of the usernames based on the comment score (and capping at 12) would add some limitations and fuzzyness to it that would meld the two. Capping at 12 would mean that both parties arguing might get the same public presentation of 00FF00 and that might quell the need for parties to prove that they're the winner of the argument by popular vote. Likewise, humans don't perceive colors exactly and that might add another layer that would diminish people comparing themselves so much and trying to score points. I guess I think it would be interesting to see if this would be a nice balance.

Example: A person posts that they think VPSs are better for hosting than renting a physical box and they talk about their reasoning (machine images that you can bring up more boxes of, launching new instances within minutes, whatnot) and it's a good comment. Someone replies espousing the virtues of physical hardware (a tad more speed, not sharing IO, whatnot). Now it becomes a bit of a competition between the two ideas (and the two posters). They were both good, valuable comments about different approaches. There is no right answer and there might not even be a better answer. The community knows this and both have comment scores above 12, but each person feels pressure to "win". With the green usernames, they're both at 00FF00 and have no idea if the community has given the other person more votes. There's no need to score points off each other or need to defend one's ego. You know you've made a valuable contribution and the other person has also, but for all you know they've gotten a good fewer votes than you. It still allows everyone reading the two comments to know that they're both generally good advice. So, there isn't a fight and an on-looker can see that both comments should be read and headed.

Re:Poll: Should HN display comment scores? by Sakes on Saturday May 28, 2011 @11:29PM (#2595908)
Of all the suggestions I've read, I think I like this one the most. But I think it is barely missing what the main problem is. Here is my twist on your idea, please tell me what you think.

Why do we want comment scores?

Because we want to be able to pick out quality comments quicker.

What is broken with comment scores?

They have created a motivation for people to try and game the comment scores. A simple way to do this is by writing polarizing comments, or kicking up an emotional debate. This hurts the comment system.

So what is the root problem? Why do people want to game the comment scores?

The reason people want to game the comment scores is because the comment scores are tied to their identity. If you can find a way to tie comment scores to the comments, and disconnect them from the user's identity, there should no longer be a motivation for people to game the comment scores.

So how can we do this? Here are a couple of my ideas.

1) Kill the current karma system and replace it with some new system. Why? Since karma is tied to comment scores, people don't just get the instant gratification of seeing their comment get voted up. They get to keep those points as long as they have the account. When you log in you see your karma score right next to your name, just begging you to try and raise it.

OR

2) After 10 upvotes (or some other chosen value) start fading the username from grey to green, and immediately replace that user's name on the entire page with a randomly chosen tag. It could be Alpha, or Liono, or characters from the 30Rock, doesn't matter. As long as it isn't directly tied to that user's identity anymore. If you replace the user's name with the same randomly chosen tag, then readers will still be able to see that that person's comments come from the same person, they just won't know who it is.

All I know for sure is that if comment scores come back they can't be tied directly to the user's identity.

Re:Poll: Should HN display comment scores? by SoftwareMaven on Sunday May 29, 2011 @01:19AM (#2596082)
I don't want to remove peoples' names from their comments. Regardless of the number of points, I will likely trust a comment from somebody like grelis.

I do like the idea of dumping any visual notification of karma. The system could keep track for whatever things it needs to (minimum karma to vote, flag, etc), but there is really no reason for the community to know what that karma is.

Re:Poll: Should HN display comment scores? by sliverstorm on Saturday May 28, 2011 @11:46PM (#2595944)
That's an interesting point; essentially the problem is comment scores tie to people's ego. If we can split comment scores from the ego, the issues with comments would be resolved.
Re:Poll: Should HN display comment scores? by bruce511 on Sunday May 29, 2011 @01:01AM (#2596063)
There are plenty of examples of sites that don't have a karma system, and they have plenty of inflammatory, insulting and personal comments.

IMO Removing karma won't improve the quality of the conversation.

Equally, anonymous, or pseudo-anonymous, comments give the commenter more freedom to make unhelpful comments.

Comments are tied to the identity, which goes at least some of the way towards them being self-moderated.

Re:Poll: Should HN display comment scores? by Sakes on Sunday May 29, 2011 @11:53AM (#2596839)
Another idea would be to switch from the positive incentives of karma, to a harsher negative incentive system. So if your karma is good, it is always 0. If you make bad comments and get down voted, it begins to go negative. You can reach zero again by making better comments later, but you can't stock pile points. Zero is as high as you can go.

I still think the perceived reward of having high ranking comments has to be removed somehow.

What do you think bruce?

Re:Poll: Should HN display comment scores? by mattgreenrocks on Sunday May 29, 2011 @01:30PM (#2597035)
I like this a lot.

Karma should be displayed to the logged in user in a vague fashion: "Karma: good." The numeric score can be maintained on the server, but never displayed to the user. Downvotes and other abilities would simply show up one day when you've passed a certain threshold, but the user should have no idea how far along they are, as we're trying to dissuade the people that want those sorts of powers (and would abuse them) from getting them. Meanwhile, negative karma could start rate-limiting you past a certain point, such as only allowing 3 posts/day.

I'm still of the belief that the only way to ensure high quality discussion is to discourage commenting for it's own sake. Everybody does not need to contribute to every article, and having a numeric karma score only legitimizes posting for its own sake.

To reiterate my support for a previous point: the only way to fix the karma system is to kill the ego's involvement in it.

Re:Poll: Should HN display comment scores? by bruce511 on Sunday May 29, 2011 @04:18PM (#2597484)
I suspect any system can be gamed for some reason or other. Equally, I suspect that making ever more complicated systems, to handle ever fewer edge cases, results in the system being less useful, not more.

Simple systems, like the current karma system, can certainly be gamed, but with each iteration general value is lost. Displaying comment scores (which I prefer) can be abused. So that's gone, and a data point with it.

Keep them, don't keep them, I don't think I'll lose much sleep either way. But as a general rule, removing data or functionality from the many, to try and prevent the excesses of the few always invokes the ire of unit ended consequences. It's almost never an improvement.

Re:Poll: Should HN display comment scores? by mrspandex on Sunday May 29, 2011 @10:38PM (#2598277)
I like the idea of not tying the karma score to the user, but that does help identify good users from bad. Maybe cap the karma the user can get from a single comment to something low - say 3, but let the comment itself show the real number of votes.
Re:Poll: Should HN display comment scores? by ssp on Saturday May 28, 2011 @11:08PM (#2595849)
A variant of this is to publicly display the logarithm of the score rounded up to an integer, maybe even as a number of stars. If the base-3 logarithm was used, the displayed scores would be:

    -infinity to 0:    bad comment, should be dimmed
    1:                 
    2-3:               ★
    4-9:               ★★
    9-27:              ★★★
    27-81:             ★★★★
    81-243:            ★★★★★
etc. Though I think scores should be computed in a more sophisticated way than they are currently.
Re:Poll: Should HN display comment scores? by mortenjorck on Sunday May 29, 2011 @12:20AM (#2596001)
There's a lot of good thinking here, but all of these suggestions share the same failing as integer scores: They still don't preclude bandwagoning. A polarizing and emotional rant with a five-star/bright-green/100%-bar rating is barely less susceptible to mob voting than a polarizing and emotional rant with 55 points.

That said, I don't think hiding scores is the only solution to this problem. I'd like to suggest an escape valve of sorts: If we accept that, from time to time, a bandwagon-bait comment will inevitably get voted up, we can consider a mechanism to deflate it. There is a simple way, to designate moderators who can demote these comments; then there is a more interesting way:

I hypothesize that there is an observable pattern to the votes over time of bait comments. It would be very interesting to see a comparison of highly-rated comments through a histogram: Is there a particular curve that insightful comments follow? Do bait comments have a signature spike at their tipping point? Can these be modeled in a straightforward way? The system could then be set up to slow, halt, or even reverse upvoting when a comment fits the model.

Re:Poll: Should HN display comment scores? by benwr on Sunday May 29, 2011 @01:27AM (#2596094)
Is mob voting an observed problem with the old way? I seem to recall PG mentioning[1] that overall top comment scores are now /higher/ than before, suggesting that upvoters didn't mob in the old system, but based their votes on the perceived value of the comment vs its current score. Thus, instead of the prevalence of vote mobbing, a more important question is: Do you think a score should be based on a ternary choice between {good comment, indifferent, bad comment} summed over a large (sometimes not-so-large) group of votes, or based on the average of the community's perception of the comment's value on a sliding scale?

[1]http://news.ycombinator.com/item?id=2465271

Re:Poll: Should HN display comment scores? by patrickk on Sunday May 29, 2011 @05:06AM (#2596315)
I think it would be a good idea to display the scores after you vote. That way you would know that you are upvoting a comment for it's merits, and it's not a case of mob mentality.
Re:Poll: Should HN display comment scores? by benwr on Sunday May 29, 2011 @05:19AM (#2596325)
I think that would be more polarizing rather than less: You would have an incentive to vote one way or the other, even when you feel the comment deserves neither.
Re:Poll: Should HN display comment scores? by Rexxar on Sunday May 29, 2011 @08:52AM (#2596549)
We could add a "+0" vote in addition of +1 and -1 votes to solve this problem.
Re:Poll: Should HN display comment scores? by tomp on Sunday May 29, 2011 @12:38PM (#2596920)
A neutral vote ("I don't want to vote") should definitely be present, since many users don't have the ability to downvote (e.g. myself).
Re:Poll: Should HN display comment scores? by wisty on Sunday May 29, 2011 @10:33AM (#2596702)
SHOUTING is a good way to get karma under the new system. It's rare for people to downvote, so comments that scream LOOK AT ME will get lots of upvotes.

Just as long as you don't overdo it, or say anything too controversial.

Re:Poll: Should HN display comment scores? by rbanffy on Sunday May 29, 2011 @08:23AM (#2596508)
> A polarizing and emotional rant with a five-star/bright-green/100%-bar rating is barely less susceptible to mob voting than a polarizing and emotional rant with 55 points.

IIRC, the comments I made that got the highest scores were accidental emotional rants that, more than embody some clever original insight, were in agreement with a large number of people. Usually the well reasoned ones get around 5. To get above that, I'd really have to play for the crowd, something I am not inclined to do. I value this place.

Re:Poll: Should HN display comment scores? by brfox on Sunday May 29, 2011 @10:50AM (#2596731)
Then maybe a comment should get a single star if it gets a moderate share (5%) of the total points, or at least 5 pts, whichever is higher. Zero starts would be the default.
Re:Poll: Should HN display comment scores? by ZachPruckowski on Saturday May 28, 2011 @11:26PM (#2595897)
If we're using stars, why not base stars on comment percentile? Every night at midnight, take all the comment scores for the last week, and determine the 90th, 70th, 50th, and 30th percentiles. So every comment in the top 10% gets 5 stars, every comment in the top 30% but not in the top 10% has 4 stars, etc.

Also, I think we should switch it up so that comments are dimmed at more like -1 or -2. Otherwise, if the first vote is a downvote, people might overlook an otherwise decent (or controversial) comment.

Re:Poll: Should HN display comment scores? by mishmash on Saturday May 28, 2011 @11:43PM (#2595937)
> Also, I think we should switch it up so that comments are dimmed at more like -1 or -2. Otherwise, if the first vote is a downvote, people might overlook an otherwise decent (or controversial) comment.

This is needed. I'm constantly upvoting valid, neutral things even if I don't really have an opinion on them simply because their first vote was down, likely by a disgruntled parent post.

Re:Poll: Should HN display comment scores? by redthrowaway on Sunday May 29, 2011 @12:05AM (#2595977)
>likely by a disgruntled parent post.

You've never been able to downvote replies to your own comments.

Re:Poll: Should HN display comment scores? by mishmash on Sunday May 29, 2011 @12:14AM (#2595989)
Oh wow 3 years and I've never noticed. Haha tells you've I've never tried to then. ;)
Re:Poll: Should HN display comment scores? by Smirnoff on Sunday May 29, 2011 @01:27PM (#2597026)
Unless they have a friend or a second account who can do it for them ;)
Re:Poll: Should HN display comment scores? by redthrowaway on Sunday May 29, 2011 @04:12PM (#2597460)
The karma threshold for downvoting comments is 500, iirc. That would make socking a fairly laborious prospect. As for meatpuppetry, if you're going to go through that much trouble just to downvote someone, then I'd suggest you have deeper issues.
Re:Poll: Should HN display comment scores? by Unseelie on Sunday May 29, 2011 @03:22AM (#2596209)
I'm often drawn to greyed things, as they're different...not sure how prevalent that reaction is, but its at least a counterweight to overlook.
Re:Poll: Should HN display comment scores? by jasonlotito on Monday May 30, 2011 @10:10AM (#2599414)
Comment's should only reflect the current thread (well, everything underneath a news story). Not all stories receive the same traffic. A quality comment in one story might receive far less votes than a less quality comment in another story that is far more popular.

However, that is merely the method, and the idea of identifying quality stories is still sound.

Re:Poll: Should HN display comment scores? by markkat on Saturday May 28, 2011 @11:20PM (#2595888)
I use something much like this on my forum and it seems to work well.

People only need a general idea of the score for it to be informative of value.

Re:Poll: Should HN display comment scores? by dpatru on Saturday May 28, 2011 @10:58PM (#2595827)
Besides the net score, I would like to see some indication of the gross number of votes to see which comments were controversial. A comment with 1 upvote is a lot different than a comment with 101 upvotes and 100 downvotes. The score could even be used instead of the net score, ie, just tell tell the readers, these are comments that got a reaction from other readers.
Re:Poll: Should HN display comment scores? by sbierwagen on Saturday May 28, 2011 @11:14PM (#2595869)
I was reading your comment and thinking about what it would like in practice, when it occurred to me that the gray -> green system is functionally identical to a horizontal bar graph that goes from 0 to 100%. You could even make the percentage visible, if you wanted to make it explicitly obvious that the purpose of the commenting system is to create comments that score a minimum number of karma.

Would that actually be better? Heck if I know. It'd certainly make grinding to 600 karma, so you can downvote people you disagree with, harder.[1]

1: Just kidding! Also, vi is better than emacs, and freebsd is quantifiably superior to linux.

Re:Poll: Should HN display comment scores? by zcksjdn on Saturday May 28, 2011 @11:02PM (#2595835)
> "Not to psycho-analyze too much, but the lack of vote scores removes the pressure to have the best comment or a better score than someone that has a different perspective."

This. ^ As someone pretty new to the HN community, I really feel like the idea in the above comment would make it easier to contribute my ideas and thoughts to a discussion.

Re:Poll: Should HN display comment scores? by dporan on Saturday May 28, 2011 @11:17PM (#2595876)
Making it easier to spot popular comments -- without showing comment scores -- would be helpful. But instead of drawing attention to the HN username, why not emphasize the comment itself, with a change of font weight and/or color? So just as downvoted comments now fade to gray, maybe the most highly rated ones should somehow stand out.
Re:Poll: Should HN display comment scores? by Vivtek on Sunday May 29, 2011 @10:40AM (#2596716)
While I'm not generally in favor of color coding (I'm colorblind) I have to agree with this variant. It gives the benefit of being able to see highly valued comments for the quick skimmer, while still avoiding or at least blunting the hypersensitivity to comment scores that encourages the worst behavior.
Re:Poll: Should HN display comment scores? by sesqu on Sunday May 29, 2011 @10:14PM (#2598230)
I like this, but with one exception: Change the background color towards white instead of the username towards green.

Adding more contrast with the background helps pick out the good/important comments, when skimming, and is consistent with the semantics of text color fading. Although it would be even more consistent if the text color transitioned to something, I think it would look worse.

An additional option would be to adjust text color by downvotes and background by upvotes - this would also highlight controversial posts, which may or may not be desirable.

Re:Poll: Should HN display comment scores? by bilban on Sunday May 29, 2011 @06:22AM (#2596370)
While I like the idea of visually being able to filter comments. I'd like to say that my eyes cannot tolerate HN's default colour scheme (and most other websites). Which means I use my own style sheet. So I don't even see dimmed down voted comments - I didn't even know that happened until now. While I could customise my own stylesheet - it would get tedious making changes for individual sites.

The point I'm trying to make, is that a score is more useful to someone using a plain text browser than a class attribute. Though there is nothing to stop you doing both.

Re:Poll: Should HN display comment scores? by dhimes on Monday May 30, 2011 @10:54AM (#2599541)
That way, one can quickly scan and see the best comments

This is exactly the wrong thinking and is why comments should be hidden. If that's what you do, you won't necessarily find the best comments, just the upvoted ones.

Here's a proposal: You can see the scores, but then you aren't allowed to vote in the thread. Maybe it can be implemented as you can see scores if you are not logged in. Then bandwagoning would have to be a deliberate act.

Re:Poll: Should HN display comment scores? by sharjeel on Sunday May 29, 2011 @12:17AM (#2595993)
I'd really like to know the number of upvotes this suggestion received!
Re:Poll: Should HN display comment scores? by yxhuvud on Sunday May 29, 2011 @03:50AM (#2596241)
I like the idea, but how would you scale it with more users (and therefore more votes) on the site?