News for hackers. Stuff that matters.
Re:Survey of scientists sheds light on reproducibility crisi... by nradov on Sunday January 05, 2020 @06:12PM (#21964898)
If we put more weight on human judgment then we'll get more favoritism, nepotism, and focus on politically popular topics. So we might end up just exchanging one set of problems for another.
Re:Survey of scientists sheds light on reproducibility crisi... by keldaris on Sunday January 05, 2020 @06:23PM (#21964978)
You won't get much more focus on politically (in the context of the academia) popular topics, the existing system already imposes that particular bias exceedingly well (how do you think you get citations?). But yes, you'll get more everyday human issues along with the judgment. In my view, that's far preferable to the existing situation, if only for the simple reason that the human problems will vary from place to place, whereas the existing system distorts virtually the entirety of academic research in roughly the same ways everywhere, to the uniform detriment of all.
Re:Survey of scientists sheds light on reproducibility crisi... by TeMPOraL on Sunday January 05, 2020 @06:25PM (#21964992)
I used to be more worried about favoritism, nepotism et al. but these days, I'm more worried about quantifiable metrics. The former are situational, and there's only so much nepotism you can engage with before your peers in other places start considering it to be in bad taste. The latter, however, can be ruthlessly and efficiently optimized, to the full exclusion of any value that's not captured in the metrics.
Re:Survey of scientists sheds light on reproducibility crisi... by inimino on Sunday January 05, 2020 @06:21PM (#21964969)
At least favoritism has some variability in it. The problem with metrics, besides being gamed, is that they are so uniform.