News for hackers. Stuff that matters.
Re:Replace Peer Review with “Peer Replication” (2021) by jakear on Sunday August 06, 2023 @09:50PM (#37029047)
Industry doesn't need peer review. The proof of the pudding is in the sales.
Re:Replace Peer Review with “Peer Replication” (2021) by ModernMech on Sunday August 06, 2023 @10:32PM (#37029352)
This is the final stage of capitalism, where market success is conflated with scientific rigor.
Re:Replace Peer Review with “Peer Replication” (2021) by jakear on Sunday August 06, 2023 @10:54PM (#37029508)
Engineering, not scientific.

High Sales = A large number of people can attest to the engineered good or service being of high enough quality that they will exchange hard earned money for the ability to use it.

Peer Review = Some folks who derive self-worth from citations ask you to add a citation to their work and you do it because you'll probably need to ask them for the same some time later.

Re:Replace Peer Review with “Peer Replication” (2021) by depereo on Monday August 07, 2023 @12:35AM (#37030176)
This doesn't really account for fraud or abuse. Plenty of profitable companies whose product is a scam, or has other factors that make it successful.

Market success isn't the same thing as validity.

Re:Replace Peer Review with “Peer Replication” (2021) by jakear on Monday August 07, 2023 @07:23AM (#37032990)
Peer review isn't the same thing as validity either. Both are proxies, sales are simply a much better proxy. Especially long term sales from an established company.

Look at it like this: a Peer Reviewed (tm) article comes out saying "Foos cannot Bar, it is impossible". The same day, Apple releases "Bar for Foos, $8/month". Over the next year you see media outlets discussing how well Foo Barring works. Online reviewers talk about how they've incorporated Barring their Foos into everyday life and it has benefitted them in all these great ways. Your colleagues at work mention their fruitful Foo Barring adventure over the past weekend. Routine posts on HN come up where hackers describe how they've incorporated the Foo Barring API's into their own products in some novel way.

Your mother then calls you up to ask if she should get involved with this new Foo Barring thing. What do you say, can Foos Bar?

Re:Replace Peer Review with “Peer Replication” (2021) by tsimionescu on Monday August 07, 2023 @02:09AM (#37030769)
A quick trip around audiophile companies should quickly disabuse you of the notion that high sales implies any kind of worth to a product. There are several companies making lots of money on selling gold HDMI, ethernet etc cables "to improve sound quality", and plenty of rubes buying them and "hearing the difference".
Re:Replace Peer Review with “Peer Replication” (2021) by memefrog on Monday August 07, 2023 @02:17AM (#37030826)
Real Hi-Fi companies like Sennheiser and Bose make far more money than people selling gold HDMI cables. And they've been making much more money for decades and will continue to make money for decades.

Grifters don't win in the long-term.

Re:Replace Peer Review with “Peer Replication” (2021) by Qwertious on Monday August 07, 2023 @11:37PM (#37044226)
>Grifters don't win in the long-term.

Plenty of religions suggest otherwise.

(Dear reader: I'm not referring to your religion - I'm referring to the other religions.)

Re:Replace Peer Review with “Peer Replication” (2021) by memefrog on Tuesday August 08, 2023 @02:11AM (#37045137)
Wow so edgy and cool. Are you a teenager?
Re:Replace Peer Review with “Peer Replication” (2021) by optionalsquid on Monday August 07, 2023 @03:33AM (#37031421)
You frequently see this kind of reasoning in medical quackery:

> Butt-candling[1] must work, just look all these happy customers!

But history is replete with ineffective or downright harmful treatments being popular long after the evidence showed them to be ineffective or harmful. Homeopathy is a prime example of this, seeing as those concoctions contain either no active ingredients or (in cases of low dilutions still labeled "homeopathic") contain ingredients picked based on notions of sympathetic magic ("like cures like").

[1] A hopefully fictional example.

Re:Replace Peer Review with “Peer Replication” (2021) by jakear on Monday August 07, 2023 @07:14AM (#37032928)
This is a perfect example. In the real world, some placebos work. You take them, believe that they will work, and they do. Fantastic! Your problem has been solved, you share your story with friend(s), the cure spreads based on how well it works for them.

It's only in academia that they must instead work in a sterile environment that some person who has never stepped foot off a school campus thinks is "more authentic" for them to be seen as legitimate.

Re:Replace Peer Review with “Peer Replication” (2021) by kibibu on Monday August 07, 2023 @12:08AM (#37029982)
Then why does it dress its marketing up in academic paper format?
Re:Replace Peer Review with “Peer Replication” (2021) by jakear on Monday August 07, 2023 @12:10AM (#37029999)
In want of sales.
Re:Replace Peer Review with “Peer Replication” (2021) by kergonath on Monday August 07, 2023 @07:43AM (#37033133)
It gives a nice patina and some legitimacy. They have no need to publish quasi-scientific articles.