Re:Replace Peer Review with “Peer Replication” (2021)
by wholinator2 on Monday August 07, 2023 @01:57PM
(#37038095)
Well there isn't a way to fix this replicative difficulty for many fields. So you're suggesting that the theoretical understanding gained from having produced a specific material just never be added to scientific understanding at all, ever. In an ideal world with ideal budget allotment there would be time and money to build entire replicating labs that can be moved and modularly reconfigured with absolute control over air particulates, pressure, flow, sufficient to replicate any room possible anywhere on earth. But if a lab in the himalayas was able to make a magnet that fundamentally reconfigures our understanfing of physical phenomena, we should simply abandon that potential deeper truth into were able to build a second lab in the Himalayas, or in the middle of the Atlantic.
Reproduction is hard, really really fucking hard. Just saying, that means we should replicate before trying to understand, means essentially cutting off the understanding.
And like others have said, if someone wants to build from it they'll depend on that information being correct, if no one can manage to ever build from it then the idea dies.
Also there's a huge difference between, replicate this study on infant response to stimulus, or spider colony behavior, and, replicate this incredibly intricate semiconductor that took years of configuration to correctly produce.
You are almost stressing all the ways we are producing garbage which is not science because it can never be reproduced due to deficient documentation of processes, changes in supply, and changes in the environment. All three can be minimized through peer replication. That’s superior to the ignoring that the science we’re doing is non-reproducible because it’s too hard and expensive approach.