News for hackers. Stuff that matters.

A comment on A new replication crisis: Research that is less likely to be true is cited more. Parent comment

Re:A new replication crisis: Research that is less likely to... by patrakov on Saturday May 22, 2021 @06:42AM (#27245274)
In the lyceum where I studied, there was one lab on Physics, where the book that accompanied the lab was deliberately wrong. We were told to perform an experiment that "should" support a certain conclusion, but actually neither the "correct" conclusion nor its opposite could be done because of the flawed setup which measured something slightly different. A lot of students (in some groups, all students) fell into this trap and submitted paperwork with the "correct" conclusion according to the book.
[ Parent | on HN ]
Re:A new replication crisis: Research that is less likely to... by brandmeyer on Saturday May 22, 2021 @11:14AM (#27247304)
A CS-specific analogy might be to give the students a compiler that has a bug in it, such that the students' code is deliberately mis-compiled. The standard of evidence to believe that the compiler is buggy is much higher than the standard to believe that my code is buggy.

A lab exercise like that could really just be selecting for chutzpah (feeling charitable) or arrogance (less charitable).

[ Parent | on HN ]
Re:A new replication crisis: Research that is less likely to... by patrakov on Saturday May 22, 2021 @03:09PM (#27249410)
Well, that's more evil than my lab. A more direct equivalent in the CS would be an algorithm description in the booklet with one subtly wrong (e.g. proven using some well-hidden circular reasoning) and uncorrectable step. The expectation would be that a good student finds the mistake instead of submitting the implementation of the flawed algorithm, or, for even better matching with my case, proves that the supposed output cannot be obtained from the inputs at all.
[ Parent | on HN ]
Re:A new replication crisis: Research that is less likely to... by tonyarkles on Saturday May 22, 2021 @10:00AM (#27246609)
I had an appendectomy just before the final first-year Modern Physics lab and had to come back in to do a make-up lab. Sure enough it was the slightly-messed-up lab where the results should in theory look exponential but come out linear. I, naturally, drew an exponential curve through the points. Lab instructor decided to grade it right there before I left and tore a strip off me.

Very valuable lesson, although it sure did suck at the time.

[ Parent | on HN ]
Re:A new replication crisis: Research that is less likely to... by economusty on Saturday May 22, 2021 @10:31AM (#27246871)
What does tore a strip off me mean?
[ Parent | on HN ]
Re:A new replication crisis: Research that is less likely to... by kencausey on Saturday May 22, 2021 @10:45AM (#27247007)
Upbraided. https://en.wiktionary.org/wiki/upbraid#English
[ Parent | on HN ]
Re:A new replication crisis: Research that is less likely to... by bussierem on Saturday May 22, 2021 @04:24PM (#27249960)
And for those ALSO thinking "what does THAT mean":

He got criticized for it.

[ Parent | on HN ]