News for hackers. Stuff that matters.
Re:A new replication crisis: Research that is less likely to... by brandmeyer on Saturday May 22, 2021 @11:14AM (#27247304)
A CS-specific analogy might be to give the students a compiler that has a bug in it, such that the students' code is deliberately mis-compiled. The standard of evidence to believe that the compiler is buggy is much higher than the standard to believe that my code is buggy.

A lab exercise like that could really just be selecting for chutzpah (feeling charitable) or arrogance (less charitable).

Re:A new replication crisis: Research that is less likely to... by patrakov on Saturday May 22, 2021 @03:09PM (#27249410)
Well, that's more evil than my lab. A more direct equivalent in the CS would be an algorithm description in the booklet with one subtly wrong (e.g. proven using some well-hidden circular reasoning) and uncorrectable step. The expectation would be that a good student finds the mistake instead of submitting the implementation of the flawed algorithm, or, for even better matching with my case, proves that the supposed output cannot be obtained from the inputs at all.