Re:Why isn't preprint review being adopted?
by heikkilevanto on Sunday March 24, 2024 @06:13PM
(#39810994)
So, we just need a meta-review to review the reviews. At a cost, of course. And in order to keep that honest, we need a meta-meta-review...
[ Parent
| on HN ]
Or possibly just a way to review the reviewers. This opens itself up to competitor bias, though, so it would need to be thought out in a way to minimize that.
Re:Why isn't preprint review being adopted?
by currymj on Sunday March 24, 2024 @06:40PM
(#39811177)
many CS conferences have something literally called a "meta-review" and then there are further senior people who read and oversee the meta-reviews. it stops there though.
Unfortunately the state of meta-review is similar to that of reviews. Rarely delves deeper, mostly acts as a summarizer for the independent reviews.
Re:Why isn't preprint review being adopted?
by MichaelZuo on Monday March 25, 2024 @08:25AM
(#39815436)
Who picks the meta reviewers?
Re:Why isn't preprint review being adopted?
by notatoad on Sunday March 24, 2024 @06:24PM
(#39811058)
we need twitter community notes for science
chuckle recall, a paper is given to 3 or 4 reviewers. No need for hierarchies of reviewers; itβs more like a jury; if all the reviewers more or less come to the same conclusion we can have a high confidence that the decision is the correct one.
Under the proposed plan, if one of the reviewers gave a review which was radically different, or otherwise obviously slap-dash job, payment could be withheld and another reviewer commissioned.