News for hackers. Stuff that matters.
Re:Remember when a glass of wine a day was good for you? by quotemstr on Sunday September 23, 2018 @03:25PM (#18052686)
> 2. While we like to claim that a study randomizing people to alcohol wouldn't be ethical, pre-2014 I don't think that would have been true. I think there was enough equipoise. Post-2014, I would need to see some strong counter-evidence to make me think there is equipoise once again.

That's a very convenient way to socially forbid replication attempts. I don't buy it. The argument basically amounts to a claim that we answered the question definitively in 2014 and anyone questioning that result now is unethical. Today's scientific research, especially in any area pertaining to people, is too unreliable to blindly trust this way.

Re:Remember when a glass of wine a day was good for you? by joshgel on Sunday September 23, 2018 @03:38PM (#18052748)
What's the line? If we found that some intervention group had 90% mortality with the control group having 10% mortality in some experiment, I think you would agree we shouldn't repeat that experiment with a lot of people as you would be randomizing to something likely to kill them. What about 20% mortality to 10%? What about 11% to 10%? What degree of certainty about the results do you need? Obviously there is a line somewhere. But, its not easy, so I wouldn't recommend dismissing such concerns glibly. Is that the same as claiming we answered the question definitively, or is that just ethical research?
Re:Remember when a glass of wine a day was good for you? by quotemstr on Sunday September 23, 2018 @04:04PM (#18052878)
We're not talking about administering arsenic to people just in case we're wrong about thousands of years of experience. We're talking about randomizing exposure to an activity that billions of people choose voluntarily, an activity that at worst has an effect of a few parts per 100,000. That's on the same order of risk as being struck by lightning. Unnecessary x-rays are likely worse. Why the outrage over this risk in particular?

Declaring this level of risk to be outside the bounds of permissible research is an attitude incompatible with scientific progress. It's elevating short-term harm prevention to an unjustifiable extreme that makes it impossible to determine whether we have an accurate model of the world.

Re:Remember when a glass of wine a day was good for you? by carbocation on Sunday September 23, 2018 @04:05PM (#18052881)
Sure, you could run an alcohol intervention by an IRB and see what they say. If they think there is equipoise they might go for it. Just because I don't agree doesn't mean I feel strongly about it or would throw down some gauntlet.
Re:Remember when a glass of wine a day was good for you? by quotemstr on Sunday September 23, 2018 @04:10PM (#18052898)
I don't accept the legitimacy of IRB rulings; I hope to see a day when these bodies stop blocking research. Researchers are competent to be ethical on their own.

My reading (not just [1], although [1] is a lucid examination) suggests to me that IRBs are net detrimental to research. There's an incentive misalignment that pushes them too far in the "harm" prevention camp and that makes it too difficult to answer scientific questions.

[1] http://slatestarcodex.com/2017/08/29/my-irb-nightmare/

Re:Remember when a glass of wine a day was good for you? by carbocation on Sunday September 23, 2018 @04:16PM (#18052933)
> I don't accept the legitimacy of IRB rulings

That's too bad. The rest of us try to learn something from Nuremberg.

Re:Remember when a glass of wine a day was good for you? by tptacek on Sunday September 23, 2018 @07:14PM (#18053866)
If I am following your logic here, you're saying that because you read a blog post in which a practitioner was surprised at how much more ethically complex it is to conduct scientific research than it is to simply deliver the current state of the art to a patient, you've come to believe that biomedical research should be freed from institutional oversight?
Re:Remember when a glass of wine a day was good for you? by quotemstr on Sunday September 23, 2018 @10:24PM (#18054600)
Yes, I think IRBs today do more harm than good. Is that yet another opinion I'm not allowed to express in polite company?
Re:Remember when a glass of wine a day was good for you? by tptacek on Sunday September 23, 2018 @10:37PM (#18054643)
You can express that opinion, but it sounds awfully like you don't understand what your source ("Scott Alexander") was saying, or perhaps that both you and your source don't understand (a) the distinction between practice and research and (b) the relative cultural fixity of institutional reviews in biomedical research versus talk therapy.

So I guess what I'd say is that it looks like the one thing you know about IRBs is that Scott from SlateStarCodex once had a run-in with them and generalized wildly from it.

Re:Remember when a glass of wine a day was good for you? by quotemstr on Sunday September 23, 2018 @10:53PM (#18054697)
If I've said something incorrect, refute it. Otherwise, stop it with the vague insinuations. You have no idea what I've read about IRBs and you haven't engaged with any specific arguments in anything I've linked. "It sounds like" is not an argument. It's putting words in someone's mouth.
Re:Remember when a glass of wine a day was good for you? by tptacek on Sunday September 23, 2018 @10:59PM (#18054723)
I'm responding to the argument you actually made, not the variety of arguments you hypothetically could have made. My response has been substantive; I've clearly read the same article you did, as well as your citation. If you're unhappy with your own argument, don't blame me for it.

I think neither of will profit from continuing this discussion, though. You can safely sum up my point as "the problems people in psychology, and the social sciences in general, have with IRBs do not necessarily generalize to biomedical research". One of the basic complaints scientists have about IRBs is the "mission creep" from human medical research to the rest of the sciences. The premise of that argument doesn't line up with your argument here on this thread.

Also, SlateStarCodex is bad.

Re:Remember when a glass of wine a day was good for you? by quotemstr on Sunday September 23, 2018 @11:14PM (#18054778)
You are not in fact responding to any argument I've made.

My point is that IRBs have an incentive structure that encourages excessive risk aversion. My citation is an instance of this phenomenon in action. It has nothing to do with the particulars of psychology. You have not attempted to address this incentive alignment argument in any way. Blocking an attempt to replicate an alcohol study due to weak evidence for a very small negative effect is another example, albeit hypothetical, of this same excessive risk aversion. You have not made a similarly substantial argument. Instead, you've just asserted that institutional review is embedded in biomedical research. It is, but I think it shouldn't be.

> Also, SlateStarCodex is bad.

It's amazing that immediately after a paragraph in which you claim to be making a substantive argument, you make a bald and unsupported assertion that an influential and widely-read blog, one that Pinker has called "wonderful", is in fact "bad".

This is not the kind of intellectual conversation that HN was meant to host.