Re:Experimental depression treatment is nearly 80% effective...
by esyir on Wednesday December 29, 2021 @09:31PM
(#29732853)
I'd also like to chime in on "effect size matters". After all, you don't need particularly large N to conclude that decapitation is going to be fatal.
[ Parent
| on HN ]
Re:Experimental depression treatment is nearly 80% effective...
by mlyle on Wednesday December 29, 2021 @09:34PM
(#29732871)
Yes---
Small n studies are often the most exciting. If you get a p<0.01 effect in 10 people vs. 10000 people... the lower bound of the effect size is similar, and so for the same prior each study should change our belief by a similar amount... but the upper bound of effect size is much larger in the large study.
The only thing that messes this logic of mine up a bit is publication bias. There's a much larger chance that small studies sit on the shelf unpublished if there's no clear effect.