News for hackers. Stuff that matters.
Re:How Should We Critique Research? by rscho on Friday April 16, 2021 @03:21PM (#26838002)
Yes, I could ask to lose my job. But again, I prefer not to. Research in certain (most?) fields is a dictatorship and even suggesting something to be fishy puts a target on your back.

In this particular case, there were multiple outcomes tested (read: tens of them) and alpha was .05

Re:How Should We Critique Research? by oldgradstudent on Friday April 16, 2021 @06:47PM (#26839884)
Do they produce mere noise, or there's additional fraud involved?
Re:How Should We Critique Research? by rscho on Friday April 16, 2021 @06:59PM (#26839963)
Noise. But don't judge too harshly, it's actually like that everywhere I got to work.
Re:How Should We Critique Research? by oldgradstudent on Saturday April 17, 2021 @04:13PM (#26847080)
That's why I judge it so harshly.
Re:How Should We Critique Research? by SubiculumCode on Friday April 16, 2021 @03:24PM (#26838040)
Man, all I can say is you are working for a bad prof then. I can't imagine any of my former advisors/colleagues/etc punishing me for declining to be a co-author.
Re:How Should We Critique Research? by rscho on Friday April 16, 2021 @03:29PM (#26838091)
I am guessing that you don't do clinical research, then ;-)
Re:How Should We Critique Research? by SubiculumCode on Friday April 16, 2021 @03:41PM (#26838252)
Im on the edge of clinical work. I work with some clinical people, but am not clinical myself. I would say that they are a bit more willing to be instrumental and throw a bunch of comparisons out and see what sticks. Its largely because of a lack of awareness about statistical issues though, and they respond well to my objections.
Re:How Should We Critique Research? by rscho on Friday April 16, 2021 @03:53PM (#26838369)
Well, most professors around here don't respond well at all to objections. All (MD) professors I've met are dangerous Excel spreadsheet warriors. Note that we have a statistician in our unit, that no one listens to because "we always did it that way, right?".

However, in a wider view the issue is far bigger than that: for a clinician nowadays it's become basically impossible to both be a really honest researcher while acquiring sufficient publication velocity to rise above. In a word, our system selects for bad actors.

Re:How Should We Critique Research? by frostburg on Friday April 16, 2021 @06:15PM (#26839642)
I occasionally help this sort of people process and visualize data (they ignore their own internal statisticians, of course), but they're friends, so I can shut them down when needed. I have heard the term "retrospective control group" being used.
Re:How Should We Critique Research? by samatman on Friday April 16, 2021 @03:54PM (#26838385)
I'm reminded of a bit of dialogue from Fight Club:

"Which car company do you work for?"

"...a major one."