Re:A study out of thin air
by matthewdgreen on Thursday June 04, 2020 @01:49PM
(#23419588)
Peer review is like a spam filter. But just because something gets past your spam filter does not mean you should assume it's accurate, particularly when malicious and fraudulent behavior is involved.
What appears to have happened here is that a rapid peer-review gave the benefit of the doubt to a purported data source, and then the community rapidly discovered that the data source was not behaving honestly. All of this occurred in a matter of a few weeks, during a time when peer-review is almost certainly moving even faster than normal due to the urgency of the pandemic.
It also is a twist on all the calls for the importance of rigorous peer-reviewed studies, as if the preprint flood is just an example of why we need traditional academic structures. Here's a case where we needed the traditional academic structure and it failed miserably, even when prestigious institutions.
The irony is that this is being caught, but outside the confines of the traditional peer review. That is, there is peer review, but in the general public of scientists. So which is better? It seems like open publication and transparency is key, more so than the traditional structures per se.