Re:Hypothes.is: Taking peer review to the Internet
by 10dpd on Saturday November 12, 2011 @04:46PM
(#3229014)
This is a great idea, however there is fundamental flaw in their hypothes.is, a flaw that is inherent in all comment-based sytems (Hacker News, Digg, Redit ).
The flaw is to score people based on past comments, thereby creating a meritocracy that will lead to those voices that need to be heard the most being lost in the noise.
Re:Hypothes.is: Taking peer review to the Internet
by tilgovi on Saturday November 12, 2011 @05:34PM
(#3229112)
That's only true under the assumption that popularity is the only factor in visibility. On hacker news that's not even true entirely because there's a temporal factor: new postings remain visible for at least a short time. However, there may exist other possible ways to artificially increase visibility in order to promote diversity. Some of these methods are the research subject of Paul Resnick at the University of Michigan who is listed as an advisor.
Re:Hypothes.is: Taking peer review to the Internet
by TheBiv on Saturday November 12, 2011 @03:24PM
(#3228796)
I enjoy the spirit of this idea!
I simply fear that clout will ultimately drive it's growth, rather than the desire to correctly inform!
Maybe impart a "prick" score (for lack of a better term) that people can rate a comment based off of how accepting the author is at discussing their viewpoint rather than denigrating the person who has a "wrong" answer!
Re:Hypothes.is: Taking peer review to the Internet
by tilgovi on Saturday November 12, 2011 @04:02PM
(#3228899)
My understanding is that attempts will be made to algorithmically promote diversity and to reward/punish social behaviors in such as way as to discourage discursive protectionism.
And of course, anyone can put anything they want on the internet, which is a form of publishing into the public domain. If you mean, publish in such a way as to get read and become part of the academic literature, that's another story.
Re:Hypothes.is: Taking peer review to the Internet
by keeptrying on Monday November 14, 2011 @03:26PM
(#3235547)
I'm talking about fully peer reviewed with conferences and the whole shebang ... Its really the only way to get that knowledge out into the public domain.
Re:Hypothes.is: Taking peer review to the Internet
by CarlBeckel on Saturday November 12, 2011 @05:44PM
(#3229142)
Their response to this concern on the FAQ at Kickstarter is as follows:
"No one has yet made an effective attempt to leverage the strengths of the Internet to improve the quality of information we consume, at the place that we consume it. In essence, we are bringing crowd-sourced peer-review to the event horizon where information is produced—the thousands of news sites and blogs on the Internet. To encourage quality, we will employ a reputation framework.
We’ve closely researched over 20 current and previous online projects such as ReframeIt, SpinSpotter, ThirdVoice, Stickis, Fleck, ShiftSpace, WebClipper, zBubbles, and others – as well as offline efforts such as FAIR and Media Matters. All have key conceptual flaws which ultimately are or were fatal limitations on their effectiveness and scalability. Hypothes.is is a direct result of our conclusion that previous efforts have missed the essential ingredients of success, and has been designed to address each of them."
The flaw is to score people based on past comments, thereby creating a meritocracy that will lead to those voices that need to be heard the most being lost in the noise.
I simply fear that clout will ultimately drive it's growth, rather than the desire to correctly inform!
Maybe impart a "prick" score (for lack of a better term) that people can rate a comment based off of how accepting the author is at discussing their viewpoint rather than denigrating the person who has a "wrong" answer!
Best of luck!
-Ben
Wow.
Why doesnt such a thing exist by the way?
And of course, anyone can put anything they want on the internet, which is a form of publishing into the public domain. If you mean, publish in such a way as to get read and become part of the academic literature, that's another story.
"No one has yet made an effective attempt to leverage the strengths of the Internet to improve the quality of information we consume, at the place that we consume it. In essence, we are bringing crowd-sourced peer-review to the event horizon where information is produced—the thousands of news sites and blogs on the Internet. To encourage quality, we will employ a reputation framework.
We’ve closely researched over 20 current and previous online projects such as ReframeIt, SpinSpotter, ThirdVoice, Stickis, Fleck, ShiftSpace, WebClipper, zBubbles, and others – as well as offline efforts such as FAIR and Media Matters. All have key conceptual flaws which ultimately are or were fatal limitations on their effectiveness and scalability. Hypothes.is is a direct result of our conclusion that previous efforts have missed the essential ingredients of success, and has been designed to address each of them."