News for hackers. Stuff that matters.
Re:Why isn't preprint review being adopted? by s0rce on Sunday March 24, 2024 @03:09PM (#39809434)
There is no place to make a note that something doesn't reproduce so its extremely time consuming or you need some source of tribal knowledge. In my postdoc I was trying to make some porous films and a bunch of paper's methods didn't seem to work, maybe I did it wrong, maybe some detail wasn't described, who knows. I couldn't get it to work and there was no way to document that failure.
Re:Why isn't preprint review being adopted? by bumby on Sunday March 24, 2024 @04:34PM (#39810244)
I wonder if there's a way to document such replaceability failures as an erratum to the original manuscript. I feel like this would help in at least two major ways:

1) It provides a reproducibility filter. If a method isn't shown to be reproducible, publically documenting that adds to the body of knowledge, and this would help drive an incentive towards reproducing work rather than just searching for novelty. It would document work that would otherwise be lost because there's no incentive to showcase it. When the lack of reproducible results isn't public, it's now more likely that others may waste considerable effort in the same vein.

3) It may enlist the original authors to help understand why the work didn't reproduce well. Maybe the secondary effort lacked some crucial step or understanding. The people best positioned to remedy this are the original authors, and this secondary publication incentivizes them to dialogue with those who couldn't reproduce the outcome. It doesn't mean they have to engage, but it at least gives them some reason to involve themselves in the process.

Re:Why isn't preprint review being adopted? by warkdarrior on Sunday March 24, 2024 @07:21PM (#39811428)
2) ???
Re:Why isn't preprint review being adopted? by bumby on Sunday March 24, 2024 @07:41PM (#39811534)
If you are willing to provide a more substantive response, I might be able to clarify.
Re:Why isn't preprint review being adopted? by s0rce on Monday March 25, 2024 @12:33PM (#39818349)
I think they meant that you only list 1) and 3) and 2) was missing.