News for hackers. Stuff that matters.
Re:Replace Peer Review with “Peer Replication” (2021) by tptacek on Sunday August 06, 2023 @03:29PM (#37025649)
That's not what publication is about. Publication is a conversation with other researchers; it is part of the process of reaching the truth, not its endpoint.
Re:Replace Peer Review with “Peer Replication” (2021) by cpach on Sunday August 06, 2023 @03:35PM (#37025719)
People in general (at least on da Internetz) seem to focus way to much on single studies, and way too little on meta-studies.

AFAICT meta-studies is the level where we as a society really can try to say something intelligent about how stuff works. If an important question is not included in a meta-study, we (i.e. universities and research labs) probably need to do more research on that topic before we really can say that much about it.

Re:Replace Peer Review with “Peer Replication” (2021) by lliamander on Sunday August 06, 2023 @05:31PM (#37027037)
Sure, and scientists need a place to have such conversations.

But publication is not a closed system. The "published, peer-reviewed paper" is frequently an artifact used to decide practical policy matters in many institutions both public and private. To the extent that Science (as an institution in its own right) wants to influence policy, that influence needs to be grounded in reproducible results.

Also, I would not be surprised if stronger emphasis on reproducibility improved the quality of conversation among scientists.