News for hackers. Stuff that matters.
Re:How Should We Critique Research? by ketzu on Friday April 16, 2021 @01:28PM (#26836720)
Preregistering studies [1] are common in some fields and a nice idea. Unfortunately my personal experience is that reproductibility, or even providing the sources for your experiments, is not something many reviewers care about in comp-sci fields. At least no conference review I received ever mentioned reproductibility no matter if it was available or not (and I am not sure anyone ever mentioned source code availability either).

[1] https://en.wikipedia.org/wiki/Preregistration_(science)

Re:How Should We Critique Research? by rscho on Friday April 16, 2021 @01:55PM (#26837080)
Pre-registration is very common in medicine. I don't see it change anything, because there are no real consequences for not doing what you registered for.
Re:How Should We Critique Research? by analog31 on Friday April 16, 2021 @02:33PM (#26837453)
Unless registration is an employment contract, it will be as binding and useful as project plans in business.