Re:Is Peer Review a Good Idea? (2020)
by hackernewds on Wednesday September 14, 2022 @12:17AM
(#32833283)
This vastly underestimates the esoteric nature, experiential knowledge and complexity required to review most research published in the scientific community. The common public cannot be expected to provide non-populist capable review of pharmaceutical level research
Re:Is Peer Review a Good Idea? (2020)
by jerojero on Wednesday September 14, 2022 @07:36AM
(#32835742)
But they can do so for deep learning and mathematics? Because in those fields, as I said, pre-publication peer review is not as common.
Of course we need peer-review and neither me nor the paper in the OP say otherwise. We just can't be gate-keeping research because of the review process; the review process needs to be re-thought and that includes the when and why.
Open science addresses a lot of the pain points that are mentioned in the article. I think we can all agree that having certain magazines that include what can be considered the best works is a good thing; people for better or worse need these instruments to seamlessly judge the base quality of an article. Regardless of my personal criticisms and potential declining quality of a particular magazine it is obviously very helpful to be able to know "hey, at least I can expect some degree of quality given that it was published in this or another magazine" specially as a student.
But this does not mean we ought to gate-keep research. Not only that, but having your publication out can open up a lot of feedback that can be incorporated and addressed. And this is where I go back to my original statement, in ML, it was very common to publish your work to arxiv for people to read through it and I think that greatly improved the speed upon which the field developed. Access is very important.
So I'm all for abolishing "pre-publication peer review".