News for hackers. Stuff that matters.
Re:A new replication crisis: Research that is less likely to... by baby on Friday May 21, 2021 @10:31PM (#27242774)
Why do people need to publish? The whole point of publishing was content discovery. Now that you can just push it to a preprint or to your blog what’s the point? I’ve written papers that weren’t published but still got cited.
Re:A new replication crisis: Research that is less likely to... by PeterisP on Friday May 21, 2021 @11:25PM (#27243117)
I need money to do research, available grants require achieving specific measurable results during the grant (mostly publications fitting specific criteria e.g. "journal that's rated above 50% of average citation rating in your subfield" or "peer reviewed publication that's indexed in SCOPUS or WebOfScience", definitely not a preprint or blog), and getting one is also conditional on earlier publications like that.

In essence, the evaluators (non-scientific organizations who fund scientific organizations) need some metric to compare and distinguish decent research from weak, one that's (a) comparable across fields of science; (b) verifiable by people outside that field (so you can compare across subfields); (c) not trivially changeable by the funded institutions themselves; (d) describable in an objective manner so that you can write up the exact criteria/metrics in a legal act or contract. There are NO reasonable metrics that fit these criteria; international peer-reviewed-publications fitting certain criteria are bad but perhaps least bad from the (even worse) alternatives like direct evaluation by government committees.

Re:A new replication crisis: Research that is less likely to... by dash2 on Saturday May 22, 2021 @01:53AM (#27243911)
Simple cetacean count of the paper itself is probably a better metric than journal, though it’s certainly not perfect either.

(I am leaving cetacean cunt in because it’s a funny autocorrect.)

(And now I’m leaving the above in, because it’s even funnier. Both genuine.)

Re:A new replication crisis: Research that is less likely to... by ISL on Friday May 21, 2021 @10:37PM (#27242816)
When you are looking for a job, are up for promotion/tenure, or applying for grants, a long publication record in prestigious journals is helpful.
Re:A new replication crisis: Research that is less likely to... by Spooky23 on Friday May 21, 2021 @10:33PM (#27242789)
Metrics. You can’t manage what you can’t measure!
Re:A new replication crisis: Research that is less likely to... by ajmurmann on Friday May 21, 2021 @11:17PM (#27243063)
"When a measure becomes a target, it ceases to be a good measure." - Marilyn Strathern
Re:A new replication crisis: Research that is less likely to... by mbg721 on Saturday May 22, 2021 @08:19AM (#27245798)
At some point, there's not going to be enough budget for both the football coach and the Latin philology professor. We should hire another three layers of housing diversity deans just to be safe.