News for hackers. Stuff that matters.
Re:Serotonin may not be a major factor in depression, study ... by simonster on Monday September 01, 2014 @03:01PM (#8254239)
I appreciate skepticism about the state of pharmacological treatment of depression. Point 2 is important: it is in fact the case that several meta-analyses of the effects of anti-depressant drugs show only modest benefit in moderate depression. However, the drugs do work, they just don't work very well in many cases. The study you cite does indeed find a clinically significant effect in the most severe cases, and the drugs have a smaller but statistically significant effect in less severe cases.

Additionally, the brain is complicated, and just because mice genetically depleted of serotonin do not show depression-like symptoms does not mean that toying with serotonin levels in a normal brain cannot alleviate depression. Even if depression isn't brought on by lack of serotonin, it can still be the case that potentiating the effects of serotonin can reverse depressive symptoms. In fact, antidepressant treatment does alleviate depression in mice, and my understanding is that the effects of antidepressants in mouse models are actually far stronger than in humans in a clinical setting.

There has been some work to track down how antidepressants work in animal models at a systems level, e.g. http://www.sciencedirect.com/science/article/pii/S0896627309... suggests that administration of antidepressants to chronic stress model mice reverses the suppressive effects of chronic stress on growth of new brain cells in the hippocampus, and this may be related to their therapeutic action.

Re:Serotonin may not be a major factor in depression, study ... by dllthomas on Monday September 01, 2014 @03:16PM (#8254287)
"my understanding is that the effects of antidepressants in mouse models are actually far stronger than in humans in a clinical setting."

Interesting. I wonder if this is a case of "you make what you measure" - since measuring effects on rats is far, far easier than measuring them on humans (and is typically a prerequisite).

Re:Serotonin may not be a major factor in depression, study ... by lutusp on Monday September 01, 2014 @03:50PM (#8254421)
Here's what you say: "However, the drugs do work, they just don't work very well in many cases."

Here's what the science says: "... antidepressant medications have reported only modest benefits over placebo treatment, and when unpublished trial data are included, the benefit falls below accepted criteria for clinical significance."

Guess which source I plan to rely on until better evidence is uncovered?

One theory has it that the positive statistic among the severely depressed resulted from a dosage effect -- because of the required dosage, those specific test subjects couldn't be blinded to the fact that they were taking the experimental drug, not a placebo, therefore the experimental protocol was compromised.

> Additionally, the brain is complicated, and just because mice genetically depleted of serotonin do not show depression-like symptoms does not mean that toying with serotonin levels in a normal brain cannot alleviate depression. [emphasis added]

First, you're overlooking the fact that the studies that got SSRIs approved in the first place relied on animal studies using the same animals.

Second, imagine a scientist saying "... just because mice genetically depleted of serotonin do not show depression-like symptoms does not mean that toying with serotonin levels in a normal brain cannot alleviate depression." Surely you see the logical error you're making here -- the argument essentially says, "if it hasn't been disproven, then it might be true." It equates an absence of evidence, with evidence.

To a scientist, the guiding precept is that an idea is assumed to be false until supporting evidence appears. This is commonly known as the "null hypothesis".

To a pseudoscientist, the guiding precept is that an idea is assumed to be true until contradicting evidence appears. You have just aligned yourself with a pseudoscientist's outlook.

http://blogs.scientificamerican.com/doing-good-science/2011/...

Quote: "While a pseudo-science is set up to look for evidence that supports its claims, Popper says, a science is set up to challenge its claims and look for evidence that might prove it false. In other words, pseudo-science seeks confirmations and science seeks falsifications."

This passage is particularly relevant to our exchange.

> In fact, antidepressant treatment does alleviate depression in mice ...

Not according to the FDA's meta-analysis quoted above. Shall I say it again? "... antidepressant medications have reported only modest benefits over placebo treatment, and when unpublished trial data are included, the benefit falls below accepted criteria for clinical significance."

> ... and this may be related to their therapeutic action.

Apart from a well-documented Placebo effect, which therapeutic action are you alluding to? Don't you understand that the present literature, generated by investigators subject to critical review by many interested parties, argues that there is no clear clinical role for SSRIs? And that the most recent study calls into question the most basic assumption of this class of drug therapy, that depression and serotonin are correlated?

We have pharmaceutical companies advocating the use of drugs to alleviate depression on slim-to-no reliable evidence, we have studies that fail to show a correlation between depression and serotonin in the same animal population used in the original drug studies, and most important of all, we have a large population of depressed people who want to believe that psychiatry has an answer to their difficulties.

As it happens, there is no present reliable answer, but there are hopeful signs that lie in other directions:

http://www.nytimes.com/2006/04/02/magazine/02depression.html...

Quote: "As it turned out, 8 of the 12 patients he operated on, including Deanna, felt their depressions lift while suffering minimal side effects — an incredible rate of effectiveness in patients so immovably depressed. Nor did they just vaguely recover. Their scores on the Hamilton depression scale, a standard used to measure the severity of depression, fell from the soul-deadening high 20's to the single digits — essentially normal. They've re-engaged their families, resumed jobs and friendships, started businesses, taken up hobbies old and new, replanted dying gardens. They've regained the resilience that distinguishes the healthy from the depressed."

Is DBS a panacea? No, not at all. First, it's a lab experiment, not a therapy. It's risky and expensive. But it shows what might result from an effort to actually understand what depression is, something that psychiatrists and psychologists seem uninterested in.

Re:Serotonin may not be a major factor in depression, study ... by simonster on Monday September 01, 2014 @04:25PM (#8254543)
Okay, I'll bite:

> Here's what the science says: "... antidepressant medications have reported only modest benefits over placebo treatment, and when unpublished trial data are included, the benefit falls below accepted criteria for clinical significance."

With all due respect, read the paper you linked to! Here's what it says in the places you didn't quote:

"Meta-analyses of antidepressant efficacy based on data from published trials reveal benefits that are statistically significant, but of marginal clinical significance [1]."

"Although the difference between these means easily attained statistical significance (Table 2, Model 3a), it does not meet the three-point drug–placebo criterion for clinical significance used by NICE."

"Although drug type and duration of treatment were unrelated to improvement, the drug versus placebo difference remained significant, and amount of improvement was a function of baseline severity (Table 2, Model 1a)."

"The difference between drug and placebo exceeded NICE's 0.50 standardized mean difference criterion at comparisons exceeding 28 in baseline severity."

> First, you're overlooking the fact that the studies that got SSRIs approved in the first place relied on animal studies using the same animals.

SSRIs were approved several decades ago, but studies in the last decade still show the same effects, e.g. the study I linked to above, which was conducted in 2009 using fluoxetine, which was approved in 1987. The lifespan of a mouse is around a year, so there is zero chance that any of the animals are the same. In Figure 1, it reproduces the result that antidepressants reduce depressive behaviors in mouse models on a variety of tests. This is not an isolated result; basically all of the rodent studies show similar findings.

> Second, imagine a scientist saying "... just because mice genetically depleted of serotonin do not show depression-like symptoms does not mean that toying with serotonin levels in a normal brain cannot alleviate depression." Surely you see the logical error you're making here -- the argument essentially says, "if it hasn't been disproven, then it might be true." It equates an absence of evidence, with evidence.

This is in response to your claim that "the drugs could not possibly work." The drugs can work even if serotonin-depleted animals are not depressed. And as I've stated, there is an abundance of evidence that the drugs do work in mice, even though serotonin-depleted mice are not depressed.

> > In fact, antidepressant treatment does alleviate depression in mice ...

> Not according to the FDA's meta-analysis quoted above.

That meta-analysis is in humans. Mice are not humans! That is a big reason why it's so hard to develop good antidepressants in the first place.

> Apart from a well-documented Placebo effect, which therapeutic action are you alluding to?

The therapeutic action in mice, which is replicated in the study I linked to and many others.

As far as DBS goes, one of the problems with determining if DBS actually works for depression is that most studies have not been placebo controlled. Also, the largest study that I'm aware of was recently shut down by the FDA for lack of efficacy: http://neurocritic.blogspot.com/2014/01/broaden-trial-of-dbs...

Re:Serotonin may not be a major factor in depression, study ... by lutusp on Monday September 01, 2014 @04:42PM (#8254609)
> The therapeutic action in mice, which is replicated in the study I linked to and many others.

Would that be the same therapeutic effect that was falsified in the most recent study, the one that showed no correlation between serotonin and depression? Neither study represents anything like a conclusive outcome, but both must be read with an open mind -- who funded the studies, how strong is the evidence, what are the p-values, and so forth.

But let's step back. Do you know what's missing from this exchange, and do you know why such exchanges tend to be so wordy and inconclusive? Both of us are discussing symptoms, descriptions, not causes. This issue will never move forward until people move beyond psychiatric descriptions and locate a biological cause for depression.

Science requires a focus on causes, explanations -- descriptions aren't enough. And this is not science, because psychiatry is not science.

For those who doubt the central role of explanations in science, I have an anecdote -- Doctor Dubious invents a new treatment for the common cold. His treatment is to shake a dried gourd over the cold sufferer until the patient gets better. Sometimes the treatment takes a week, but it always works — the cold sufferer always recovers. So, why doesn't Doctor Dubious get a Nobel Prize for his breakthrough?

The answer is that the procedure is only a description — shake the gourd, patient recovers — without an explanation, without a basis for actually learning anything or being truthful about the connection between cause and effect. It's the same with psychiatry.

Re:Serotonin may not be a major factor in depression, study ... by dllthomas on Monday September 01, 2014 @05:15PM (#8254722)
"For those who doubt the central role of explanations in science, I have an anecdote -- Doctor Dubious invents a new treatment for the common cold. His treatment is to shake a dried gourd over the cold sufferer until the patient gets better. Sometimes the treatment takes a week, but it always works — the cold sufferer always recovers. So, why doesn't Doctor Dubious get a Nobel Prize for his breakthrough?"

You always go to this example, but it does not convince anyone of anything because you are not only foregoing explanation but also a control group. If you do have a randomly assigned group of people who get gourd-shook and a randomly assigned group of people who do not, and those who do recover significantly faster than the those who do not, and you have no idea how gourd-shaking might cause that... maybe it's still incorrect to say "the study showed gourd-shaking effective in treating the cold" but that's not intuitively obvious - explain why.

Re:Serotonin may not be a major factor in depression, study ... by lutusp on Monday September 01, 2014 @05:54PM (#8254834)
> You always go to this example, but it does not convince anyone of anything because you are not only foregoing explanation but also a control group.

Yes, because my example is meant to caricature psychological "science" -- that's its purpose. Therefore it must have the same logical pitfalls as the class of study it caricatures.

Is there a suggestion that psychiatrists or psychologists have control groups that work? Does the expression "no-treatment control" sound familiar? It's an often-seen expression in psychiatry and psychology studies. It results from an awareness that real scientists have control groups, but because of the nature of psychological studies, that's often not practical (imagine a study comparing therapeutic methods -- how would one design a realistic faux therapy for control purposes?).

But these people want the appearance of science, so they call those denied treatment a "no-treatment control". "Send him home, we're not treating him. Oh, and add him to the 'no-treatment control' group."

http://www.academia.edu/186808/The_Selection_and_Design_of_C...

Quote: "Although no-treatment controls have an appealing simplicity, they also have a number of potential disadvantages."

I always laugh when I read that.

> ... maybe it's still incorrect to say "the study showed gourd-shaking effective in treating the cold" ...

Remember that I was mimicking a psychiatrist or psychologist, the sort of person willing to publish a paper containing this kind of reasoning in a theoretical vacuum.

Anyway, the absence of a central corpus of falsifiable theory in psychiatry speaks for itself. All real sciences have such a corpus of theory, it's falsifiable and it informs all work in the field, psychiatry doesn't have one. Psychiatrists are free to go in any direction they please, even contradict each other on matters of substance, and without a basis in theory. It's not science.

Re:Serotonin may not be a major factor in depression, study ... by dllthomas on Monday September 01, 2014 @06:14PM (#8254901)
'Yes, because my example is meant to caricature psychological "science" -- that's its purpose. Therefore it must have the same logical pitfalls as the class of study it caricatures.'

You explicitly stated that the example was "for those who doubt the central role of explanations in science". That you can throw together an example with a bunch of flaws that produces a flawed result is both unsurprising and not especially damning of any specific one of the flaws - one flaw is enough to be wrong. Therefore, your example is not very persuasive on the issue you claimed it directed at.

If you're just trying to get your jollies lampooning everything that sometimes goes wrong with psych research, that's fine - but present it that way. If you're trying to help people reason better - and possibly find flaws in your own reasoning - isolating particular problems is a much better approach.

Re:Serotonin may not be a major factor in depression, study ... by lutusp on Monday September 01, 2014 @07:14PM (#8255057)
> You explicitly stated that the example was "for those who doubt the central role of explanations in science".

Yes, and my example proves the point I am making -- one must have tentative, falsifiable explanations in science. Choose your own example if you don't like mine, but make no mistake about it -- scientists explain things. If the explanations fail, then another explanation is tried. But description is not science, that's stamp collecting.

This goes as far back as Francis Bacon, who first articulated it -- reading Bacon's philosophical works, the role of explanation, of theory, is clearly set out as a requirement.

More recently, falsifiability has been made a requirement for science, especially in cases where science is defined in legal actions. And descriptions cannot be falsified -- if I say that I saw many tiny points of light in the night sky, that can hardly be falsified. But if I make the claim that those points of light are actually thermonuclear furnaces at a great distance, that explanation is open to examination and falsification, and I have crossed the threshold of science.

This is why the dried gourd example is perfect for my purpose -- it aptly caricatures real psychological work. And once one tries to take a step toward science, to explain the result, it falls apart, like so many psychological studies do.

Re:Serotonin may not be a major factor in depression, study ... by dllthomas on Monday September 01, 2014 @07:27PM (#8255089)
It's like you know what you want to rant about, and it doesn't matter what you're actually responding to. I'd hoped to learn something, but I think I've got to give up on your posts.
Re:Serotonin may not be a major factor in depression, study ... by lutusp on Monday September 01, 2014 @07:55PM (#8255143)
> It's like you know what you want to rant about ...

You mean by quoting authoritative sources like the chairman of the NIMH, whose views resemble my own?

> ... but I think I've got to give up on your posts.

Feel free, but if you've managed to miss the historical change taking place in mental health right now, then nothing I might say will help. The tl;dr is that neuroscience is taking over.

Re:Serotonin may not be a major factor in depression, study ... by dllthomas on Monday September 01, 2014 @08:15PM (#8255176)
Given that your quoting of Insel wasn't in response to me, wasn't related to anything I said, and given that I've not been disputing anything Insel said... You demonstrate an eagerness to rant about issues that you're sure you're right about (and often are) regardless of whether they actually address the thing you are replying to, and keeping up is too much work getting past the noise.
Re:Serotonin may not be a major factor in depression, study ... by pessimizer on Monday September 01, 2014 @05:02PM (#8254682)
> "... antidepressant medications have reported only modest benefits over placebo treatment, and when unpublished trial data are included, the benefit falls below accepted criteria for clinical significance."

vs.

> "Meta-analyses of antidepressant efficacy based on data from published trials reveal benefits that are statistically significant, but of marginal clinical significance [1]."

Are you sensing some kind of contradiction here? Both are quotes, both are truthful, one includes unpublished studies and one does not. Are you honestly arguing that we shouldn't include the unpublished studies (which tend more to negative results than the published ones - big surprise.)

It's pretty dirty to accuse the person you're having a discussion with of not reading the paper, especially when you never explained the problem in what lutusp claimed but just relied on innuendo to carry you through.

Re:Serotonin may not be a major factor in depression, study ... by simonster on Monday September 01, 2014 @05:13PM (#8254710)
Sorry, I will clarify further.

There is a difference between statistical and clinical significance. Statistical significance indicates that there is a real effect that is not due to chance. Clinical significance is achieved only if the effect size exceeds a certain threshold. The clinical significance criterion used by the study lutusp linked to is "a three-point difference in Hamilton Rating Scale of Depression (HRSD) scores or a standardized mean difference (d) of 0.5." That study shows antidepressant treatment does not have clinically significant effects beyond placebo in all but the most severe cases of depression; the effect size is quite small. However, the effects are statistically significant (in previous meta-analyses of published studies and this meta-analysis of both published and unpublished studies) and thus likely to be real, and they are clinically significant in the most severe cases of severe depression, even when unpublished studies are included.

To summarize, antidepressants do work: their effect is statistically significant. But they don't work very well: their effect is not clinically significant in any but the most severe cases.

Re:Serotonin may not be a major factor in depression, study ... by lutusp on Monday September 01, 2014 @06:26PM (#8254940)
> To summarize, antidepressants do work: their effect is statistically significant.

This is deliberately misleading. You just explained that statistical significance is not clinical significance, but saying "antidepressants do work" strongly implies that they subjectively improve a person's state. These are words you chose, words that contradict the study's conclusion with respect to human subjects in all but the most severely depressed.

> But they don't work very well: their effect is not clinically significant in any but the most severe cases.

This is like saying, "the skydiver was perfectly all right until he hit the ground." It's misleading. If he used language like this, a clinician could be accused of unethically misleading his patients.

The reason for the wide gap between statistical and clinical significance is to guard against the distorting effect of self-reporting, always a risk in a study like this. I want to repeat what you said above, but broken down:

(a) "To summarize, antidepressants do work:"

(b) "their effect is statistically significant."

But according to your own analysis, item (a) does not -- cannot -- acquire its authority from item (b), for the reason that statistical significance doesn't lead to the claim that these drugs "work" in the commonly accepted sense, i.e. subjective improvement in a human subject.

I refer again to the difference between science and pseudoscience I quoted earlier -- pseudoscientists seek confirmation, scientists seek falsification. The outcome for the layman? If a scientist cannot falsify something, it acquires a small bit of temporary credibility, but if a pseudoscientist says something works, well, read the study behind the words.

Re:Serotonin may not be a major factor in depression, study ... by dllthomas on Monday September 01, 2014 @05:18PM (#8254736)
"However, the effects are statistically significant and thus likely to be real (whether based on published or both published and unpublished studies)"

I don't see how you get the parenthesized bit.

Re:Serotonin may not be a major factor in depression, study ... by simonster on Monday September 01, 2014 @05:26PM (#8254752)
I put the parens in the wrong place. What I meant was that the effects are statistically significant in both previous meta-analyses and this one. I've adjusted my comment above to make it a bit clearer.
Re:Serotonin may not be a major factor in depression, study ... by dllthomas on Monday September 01, 2014 @05:33PM (#8254770)
Ah, that clarifies quite a bit.