News for hackers. Stuff that matters.
Re:Experiment: No Comment Scores by kniwor on Saturday September 26, 2009 @02:56AM (#845191)
But now I cant quickly skim off information from a thread. There are 87 comments in this thread at this moment. I am not interested in reading 87 comments about this experiment. I am however very much interested in seeing what the top few most insightful comments in this thread are. That feedback is very important. Right now I am feeling blind as a bat...
Re:Experiment: No Comment Scores by DanielBMarkham on Saturday September 26, 2009 @03:03AM (#845201)
I feel your pain. I don't think I like the new system that much. At least so far.

I'm used to scanning comments as a way to determine which articles to read. Postings with a lot of comment action usually indicate something emotionally appealing.

Once I go to the comments section, then I filter by score, only looking at comments above a certain threshold (depending on how much time I have). I usually try not to comment, unless some comment has been upvoted to a high level and doesn't make sense to me.

Alas, there are a huge number of comments that I disagree with or fail to understand, and only by knowing the score am I able to determine whether or not my adding to the discussion will help the other readers.

That don't work no more. Now I'm just blindly poking around in the comments section, not really feeling connected to the discussion at all...

Re:Experiment: No Comment Scores by mechanical_fish on Saturday September 26, 2009 @10:01AM (#845455)
This is precisely the problem. Without some idea of what earlier readers think of the comments it is much harder to skim.

The top-level comments presumably rise and sink based roughly on their karma (though the algorithm also seems to have other considerations, like momentum). But what of the second-tier comments and below? Ripostes are often where the action is.

I might find that I'm reduced to skimming for names that I recognize. That's how the rest of the web works. The web in general has no karma system, so the way to "upvote" something is to repeat it with your byline: You Twitter it or reblog it (or retweet it, or re-reblog it) with a link and your signature, implying a certain degree of implicit endorsement.

I expect that if this system holds we'll start seeing more "amen" comments. I kind of hope so, frankly: Now the only way I will spot an incredibly insightful but short comment buried downthread is if I see a bunch of comments from people I vaguely know saying "amen".

I'm not sure this trend will represent progress, however.

If we want to tinker, consider this: relative rankings on a page. Find a way to distinguish the top-voted 20% of comments from the second quintile, and the second quintile from everything else. (My instinct is not to bother distinguishing things below the top 40%, and of course negative-karma comments presumably are still doing their disappearing act, my favorite cute HN feature.)

At the risk of repeating the legendary eye-searing Orange Name experiment... we could turn the byline of comments in the top 20% a different color from the second 20%, which in turn is a different color from everything else.

Red is probably the wrong color for any of this -- too loud. Think "green". I'm thinking shades of green: Comments in the first quintile have very green bylines, comments in the second quintile have slightly green bylines, and all the other comments have their usual light grey bylines.

Re:Experiment: No Comment Scores by Perceval on Saturday September 26, 2009 @11:35AM (#845595)
I may be off base here, but perhaps HN isn't being designed to make skimming easy. Having only a light or superficial engagement with the content, and then voting on that content, is probably what the site is supposed to be avoiding.

PG wrote an essay which discussed the 'fluff principle' at work in other voting-based aggregator communities, in which the most superficially sensational content usually rose to the top, beating out longer-form but more intellectually substantial content: http://www.paulgraham.com/hackernews.html

I think this move by PG is aimed at reducing the herd mentality of voting, and reducing the ability of readers to engage in voting without having engaged the content first.

However, I think your scheme of highlighting comments by quintile is probably a good one. It gets us away from thinking about raw scores, but also serves to reward and reinforce good commenting contributions/behavior by setting an example for others to follow. In order to stave off the herd mentality of 'piling on' upvotes or downvotes, perhaps votes made subsequent to highlighting (or greying out in the case of negative comments) should have half the weight.

Re:Experiment: No Comment Scores by mechanical_fish on Saturday September 26, 2009 @01:02PM (#845708)
Having only a light or superficial engagement with the content... is probably what the site is supposed to be avoiding.

If you think that the secret to encouraging engagement is to flatten out the structure of the information, and ask everyone to read everything in order to discover the influential, popular, or insightful bits...

... you desperately need to read The Paradox of Choice:

http://www.amazon.com/Paradox-Choice-Why-More-Less/dp/006000...

There is nothing engaging about thirty screenfuls of undifferentiated choices. When presented with that, I'll just leave. If I wanted a firehose of undifferentiated, recent, quality content, presented in a way which made it very difficult to nucleate a conversation or form a community, I'd be using Google Reader.

[EDIT: Incidentally, if not illustratively, I should point out that I haven't actually read the entirety of The Paradox of Choice myself. I listened to the author lecture about it for an hour in a podcast, and I started to read it, and I appreciated the concept, but I felt that the book kept repeating the same point too many times and I had other uses for my time... ;]

Re:Experiment: No Comment Scores by DanielBMarkham on Saturday September 26, 2009 @06:27PM (#846194)
This is precisely the problem. Without some idea of what earlier readers think of the comments it is much harder to skim.

Yes. It's like "we want the voting system for our own purposes. You schmucks can just read every comment under an article because your time is not as valuable to us as our desire to prevent mobbing"

I'm sure that's not the case, but that's the way the new system feels.

Re:Experiment: No Comment Scores by moe on Saturday September 26, 2009 @10:24AM (#845492)
Amen.
Re:Experiment: No Comment Scores by greendestiny on Saturday September 26, 2009 @08:39AM (#845386)
I don't look at the score to understand a comment, I look at the score to understand the community response to a comment. To me there is just less information now.
Re:Experiment: No Comment Scores by Confusion on Saturday September 26, 2009 @07:00AM (#845333)
For me, comment rankings also serve to verify the correctness of my thoughts about the article or a previous comment. I believe this is completely normal and reflects the ability to doubt yourself. The fact that I initially think a story or comment is valuable, does not mean it actually is valuable: I may be wrong. As there will usually be comments reflecting different sides of the issue, I need to know what the community thinks the value of these comments is, relative to each other.

20 Points for a comment 'supporting' my position and 20 for a comment arguing 'against' my position indicate that I shouldn't be too certain, but that my position is (probably) at least rational.

20 Points for a comment 'supporting' my position and 1 for a comment arguing 'against' my position is an additional sign that I am probably on the right track.

1 Point for a comment 'supporting' my position and 20 for a comment arguing 'against' my position is a clear sign that I may have missed something and should read that comment carefully.

I really dislike this change.

Re:Experiment: No Comment Scores by unalone on Saturday September 26, 2009 @10:15AM (#845472)
That implies you trust the community more than you trust your own judgment.

If somebody refutes you elegantly, then you should look into their refutation regardless of whether or not the refutation has many points.

Re:Experiment: No Comment Scores by icey on Saturday September 26, 2009 @10:28AM (#845496)
I'm in a similar boat to Confusion on this one. I don't care about elegance; if I make a comment and then someone shows up with 2 sentences that basically say "You're an idiot. Obviously the answer is X." then context is important. Without knowing what the score is, I'll probably disregard the comment because I obviously disagree. However, if my comment has 1 point and the responder's has 50 points, then I know there's a pretty good chance I'm wrong, and know to go investigate.
Re:Experiment: No Comment Scores by unalone on Saturday September 26, 2009 @10:42AM (#845524)
Perhaps I'm in the minority; I'd downvote that even if it was right because that's a shitty attitude for somebody to take.

Meanwhile, I think if somebody replies to you with something like that, it's worth investigating regardless of if they're the top answer or not. I'll draw a parallel to Reddit's "What's your favorite album?" threads. If you were to go by comment points alone, you'd think Radiohead's OK Computer was the best album of all time and that NIN took the four spots under that; meanwhile, albums out of the hive mind don't get as many upvotes, even if the commenter is more passionately in love with them.

Similarly, just because a lot of people think one thing on HN doesn't mean that one thing is the best answer. Looking up multiple solutions may take more time, but that leads to learning and growth, which I think should be the point of any community.

Re:Experiment: No Comment Scores by icey on Saturday September 26, 2009 @11:15AM (#845573)
I don't know what kind of time you have available in an average day, but I can tell you that I don't have the time to go research what every yahoo with an opinion has. I don't mind being wrong, but if I say something, I am saying it because I think I'm right. Just because someone disagrees with me doesn't make me think I should go spend the time trying to prove their position.
Re:Experiment: No Comment Scores by unalone on Saturday September 26, 2009 @11:30AM (#845594)
You're awake for sixteen hours a day and you can't spend five minutes looking up what somebody's talking about? Research nowadays doesn't take a long time.
Re:Experiment: No Comment Scores by scott_s on Saturday September 26, 2009 @02:03PM (#845797)
Five minutes multiplied by several people is a long time in a day.

You obviously participate in HN a lot. Don't fault the rest of us for only wanting to do it part time.

Re:Experiment: No Comment Scores by unalone on Saturday September 26, 2009 @02:31PM (#845843)
It's not a matter of doing it "part-time". The original example given was that if somebody said "this way is better" and they had lots of upvotes, then it would be worth looking into. Thing is, that's a rare case in a conversation. Most talks here are opinionated, and opinions don't require research. In the off-chance that there is a comment that has, say, five responses suggesting alternative methods, then that's obviously a subject that warrants research on the part of the original commenter, if he cares at all about the subject.
Re:Experiment: No Comment Scores by Confusion on Saturday September 26, 2009 @06:27PM (#846192)
I trust both my own and the community's judgment. In general, I don't value one above the other. However, when they are at odds, that is an indication that I need to pay special attention, either because I am wrong, because many people are somehow wrong (which I think is quite relevant knowledge), because the situation isn't as clearcut as I may have thought, etc. In specific cases, I may come to value one judgment above the other, which does not necessarily mean dismissing the other judgment. These things are quite gray and I feel comment scores help in distinguishing the shades of gray.
Re:Experiment: No Comment Scores by mbrubeck on Saturday September 26, 2009 @03:19PM (#845925)
To me, the points are a way for other readers to signal agreement without needing to clutter the thread with dozens of "me too" comments. A score of 50 gives a comment the force of many voices, but it compacts those voices into two efficient bytes.

Sure, it's a noisy signal because scores don't just indicate agreement, but the context usually makes that clear. If a factual claim is up- or downvoted, it usually indicates that people believe the claim is true or false. For analysis or opinion, it may have to more with whether the comment is insightful or thought-provoking.

Re:Experiment: No Comment Scores by tumult on Saturday September 26, 2009 @03:00AM (#845196)
Ones near the top are some kind of product of age (more recent) and score (higher).

By the way, the kind of skimming you're describing is what leads to mob voting :) People skim for the highest rated stuff, read it, then rate it up more. Plenty of good comments never get rated up, and people who say the most inflammatory stuff (or just make stupid jokes) get the votes early on and stay in the "lead" as it were, the system having been made into a game.

Re:Experiment: No Comment Scores by DanielBMarkham on Saturday September 26, 2009 @03:07AM (#845208)
Repeat after me: you cannot have a system with points and expect people not to play games with it. Just accept it as a given and try to work around mob voting in other ways. Perhaps there is a way to make the system work against it's own mob tendencies.

The entire point of using karma is that it means something -- it has value. Heck, I bet to some folks it has a lot of value. I'd further bet that it has so much value to some folks that you could monetize it. But that's a discussion for another day.

Re:Experiment: No Comment Scores by unalone on Saturday September 26, 2009 @10:18AM (#845478)
Repeat after me: you cannot have a system with points and expect people not to play games with it.

Exactly! A lot of games just got killed, and now we're hearing some protesting about it.

The entire point of using karma is that it means something -- it has value. Heck, I bet to some folks it has a lot of value. I'd further bet that it has so much value to some folks that you could monetize it. But that's a discussion for another day.

You don't find it slightly pathetic that people would be judging themselves by the score of their comments on a web site? And I say this as an upstanding member of the Karma Kommunity.

There is, actually, one system of points that works brilliantly. Metafilter's favoriting system, which allows upvotes but not downvotes, lets top comments get notified, but doesn't penalize any other comments, and because MF uses a flat commenting system the conversation isn't at all affected by what people like and dislike.

Re:Experiment: No Comment Scores by tumult on Saturday September 26, 2009 @03:19AM (#845217)
Of course it's a game. But it should be a game that fosters insightful comments and interesting threads, not one-liner jokes and inflammatory outbursts.
Re:Experiment: No Comment Scores by DanielBMarkham on Saturday September 26, 2009 @03:27AM (#845225)
I agree.

I wonder if you could just have three buttons/widgets: insightful, funny, and troll.

Then just click what you think of the article, and insightful articles rise to the top.

Heck, you could even make it a user preference whether to sort insightful first, funny first, or troll first (why you'd want to do that I don't know, but some might)

It would involve just one more graphic element than the current up/down arrows, and would give people release to say the funny things when they feel like they have to instead of having the site self-police.

Re:Experiment: No Comment Scores by camccann on Saturday September 26, 2009 @09:44AM (#845440)
or troll first (why you'd want to do that I don't know, but some might)

At least on slashdot, the "troll"s are sometimes, in their own way, funnier than the "funny"s (if only because of not involving overdone /. in-jokes).

Re:Experiment: No Comment Scores by DanielBMarkham on Saturday September 26, 2009 @06:45PM (#846218)
I'd go so far as to say that I'd enjoy reading jokes and one-liners the folks here have to say about the news. We've got some really smart people that read HN. I bet their jokes are hilarious.

But that's only sometimes, not all of the time. If there could be a button for turning jokes off or on (or sorting by funny) then it'd be a hoot to see the site in that asepct.,

In short, I don't think it's a human behavior problem. Computer systems should let people act like people naturally act. This is a display problem. Some folks are seeing things in spots they would not like them to be in.

Instead of viewing the site as some huge function to take limited input and provide maximum output, perhaps it's better viewed as a big bucket of various randomized data. Then the purpose of the site is to sort and organize that random data in such a way as to provide maximum utility.

Re:Experiment: No Comment Scores by johnnybgoode on Saturday September 26, 2009 @07:13PM (#846249)
> I'd go so far as to say that I'd enjoy reading jokes and one-liners the folks here have to say about the news. We've got some really smart people that read HN. I bet their jokes are hilarious.

I agree. HN, while of course useful in other ways, seems so humorless to me. I understand that some HNers are paranoid about HN turning into Slashdot or Reddit, but it would probably be nice sometimes to have a more community-like feel, even if it were totally segregated from the "real" HN.

Re:Experiment: No Comment Scores by tumult on Saturday September 26, 2009 @03:48AM (#845239)
I think you just described slashdot without visible karma counts :)
Re:Experiment: No Comment Scores by Perceval on Saturday September 26, 2009 @11:42AM (#845600)
I agree. As an administrator on Wikipedia since 2004, I have to say that, while Wikipedia is not perfect, I do appreciate their skeptical stance toward voting. Especially where points matter and pseudonimity allows for multiple accounts, voting runs into awful problems. The Wikimedia foundation has codified some of their thoughts on the negative effects of voting here: http://meta.wikimedia.org/wiki/Voting_is_evil
Re:Experiment: No Comment Scores by kniwor on Saturday September 26, 2009 @03:14AM (#845215)
I think you hit the nail on it's head in the later part of your comment. I think what is killing reddit is that funny attracts 10x votes when insightful attracts x and lately that is exactly what is happening here. But I don't think this experiment is a solution at all. The thread as ordered by the HN algo is definitely not the right order to read a thread.
Re:Experiment: No Comment Scores by borism on Saturday September 26, 2009 @04:53AM (#845268)
there is no one single "right" - there is better and worse.

I think this change is for the better.

Re:Experiment: No Comment Scores by selven on Saturday September 26, 2009 @05:41AM (#845288)
We could always make a compromise where people who choose to moderate can't see scores. It would be trivial to circumvent but it will deter 90% of people, and here that's 90% as good as deterring 100%.