News for hackers. Stuff that matters.
Re:The Unintended Consequences of Trying to Replicate Research by nonbel on Sunday April 24, 2016 @02:38PM (#11560781)
This is more of a problem if you use a weak definition of replication such as: "statistically significant effect in the same direction". If instead the effect sizes need to be similar to each other (+/- some uncertainty), then a correspondence between the multiple results means much more.

Of course, if people will just game this system to only publish results that fit whatever criteria then you will get a biased literature. Requiring a more precise range of results to qualify just makes it more difficult.

I don't see how people gaming the system is a consequence of replicating each others results though. That seems like it is due to deeper cultural problems.

There are no comments on this comment yet.