News for hackers. Stuff that matters.
Re:A new replication crisis: Research that is less likely to... by PeterisP on Friday May 21, 2021 @11:25PM (#27243117)
I need money to do research, available grants require achieving specific measurable results during the grant (mostly publications fitting specific criteria e.g. "journal that's rated above 50% of average citation rating in your subfield" or "peer reviewed publication that's indexed in SCOPUS or WebOfScience", definitely not a preprint or blog), and getting one is also conditional on earlier publications like that.

In essence, the evaluators (non-scientific organizations who fund scientific organizations) need some metric to compare and distinguish decent research from weak, one that's (a) comparable across fields of science; (b) verifiable by people outside that field (so you can compare across subfields); (c) not trivially changeable by the funded institutions themselves; (d) describable in an objective manner so that you can write up the exact criteria/metrics in a legal act or contract. There are NO reasonable metrics that fit these criteria; international peer-reviewed-publications fitting certain criteria are bad but perhaps least bad from the (even worse) alternatives like direct evaluation by government committees.

Re:A new replication crisis: Research that is less likely to... by dash2 on Saturday May 22, 2021 @01:53AM (#27243911)
Simple cetacean count of the paper itself is probably a better metric than journal, though it’s certainly not perfect either.

(I am leaving cetacean cunt in because it’s a funny autocorrect.)

(And now I’m leaving the above in, because it’s even funnier. Both genuine.)