News for hackers. Stuff that matters.
Re:The Problem Is Not Plagiarism, but Cargo Cult Science by p_l on Thursday January 18, 2024 @05:22PM (#39048707)
The problem is that replication studies aren't done hard enough.

And by replication studies I mean "take this paper, try to replicate, write a paper on it".

Every singular paper can be wrong, that's why you're supposed to replicate them - that's at least what was taught in psychology, which many consider "social science of less rigour" - well, it was probably the course most hardcore about experimental design in my education and ability to replicate a study...

Re:The Problem Is Not Plagiarism, but Cargo Cult Science by the_snooze on Thursday January 18, 2024 @07:01PM (#39049793)
>The problem is that replication studies aren't done hard enough.

>And by replication studies I mean "take this paper, try to replicate, write a paper on it".

You don't necessarily need to perform a straight-up "replication study" in order to do some useful sanity checking on published results. It can be done as part of another novel study that builds upon prior work. That's basically what happened with the fraudulent UCLA political persuasion study several years ago [1]. Some Berkeley researchers wanted to extend the ideas in that earlier published paper, reused similar methods under the assumption that the UCLA folks were correct, and couldn't get anything reasonable within the ballpark of what was published.

[1] https://fivethirtyeight.com/features/how-two-grad-students-u...

Re:The Problem Is Not Plagiarism, but Cargo Cult Science by maximus-decimus on Thursday January 18, 2024 @05:39PM (#39048896)
Are they not done or are they done and nobody wants to publish them?
Re:The Problem Is Not Plagiarism, but Cargo Cult Science by neuronerdgirl on Friday January 19, 2024 @02:34AM (#39052654)
Nobody CAN publish them. An actual criterion for most top journals is literally "novelty". Reviewers will immediately levee "this has been done before" as a damning critique in peer review. There is no replication because you can't currently share replications, let alone sustain a career on them.
Re:The Problem Is Not Plagiarism, but Cargo Cult Science by zilti on Thursday January 18, 2024 @06:37PM (#39049524)
My experience of "representative" studies in psychology (university of Berne) was that they'd come up with something, then gather a group of "volunteer" psychology students - 80% women - who need to participate at x studies as requirement to pass, publish it as representative serious research, and call it a day.