News for hackers. Stuff that matters.
Re:Twenty-nine teams use same dataset, find contradicting re... by SilasX on Tuesday March 15, 2016 @08:34PM (#11294127)
Reminds me of the idea (Robin Hanson's, I think?) to add an extra layer of blindness to studies: during peer review, take the original data, and write a separate paper with the opposite conclusion. Randomize which reviewers get which version. Your original paper is then only accepted if they reject the inverted version.
Re:Twenty-nine teams use same dataset, find contradicting re... by gwern on Tuesday March 15, 2016 @11:58PM (#11294904)
I think you misremembered it: http://www.overcomingbias.com/2007/01/conclusionblind.html http://www.overcomingbias.com/2010/11/results-blind-peer-rev... Nothing about accepted only if they rejected the reversed version; just that the pro & con versions be supplied (first post), or a paper sans conclusions/results (second post).