News for hackers. Stuff that matters.
Re:Our brutal science system almost cost us a pioneer of mRN... by alpineidyll3 on Saturday February 13, 2021 @07:41PM (#26128551)
How about actually measuring them by the citation count on their papers (note this is already a minor factor in tenure decisions, after monies brought in :P )
Re:Our brutal science system almost cost us a pioneer of mRN... by cycomanic on Sunday February 14, 2021 @03:44AM (#26130674)
The thing is, you're trying to create a metric that measures an essentially unmeasureable quantity and to predict future outcomes on this.

Moreover you're trying to do this for generally very smart people, so obviously they adapt their behaviour to those metrics (they game the system is a less favourable way of saying this). So the only thing you have achieved that the academics change their work to maximize those metrics. We have seen this with grants as well, to be successful you essentially have to write lots of grant (a period without grants can be career ending), so academics spend up to 50% of their time on grant writing and reviewing. At this point I'm not convinced a lottery would not be a better way of distributing money (and I say that as someone who has been fairly successful at getting grants)

Re:Our brutal science system almost cost us a pioneer of mRN... by jltsiren on Sunday February 14, 2021 @12:46AM (#26130011)
Citations are cheap, and they are being gamed all the time. It's like search engine optimization, but on a smaller scale.

Grants are one of the least bad means of evaluating a researcher, because the decisions are not made lightly. Getting funded usually implies that experts have spent a nontrivial amount of time judging the merits of the applicant and their ideas and found them particularly worthy.

Re:Our brutal science system almost cost us a pioneer of mRN... by alpineidyll3 on Sunday February 14, 2021 @01:14AM (#26130113)
Having gotten grants including the NSF career award. I respectfully disagree lol.
Re:Our brutal science system almost cost us a pioneer of mRN... by mcguire on Saturday February 13, 2021 @10:46PM (#26129486)
Has a bit of a problem for them as don't have many papers yet.