News for hackers. Stuff that matters.
Re:Experimental depression treatment is nearly 80% effective... by esyir on Wednesday December 29, 2021 @09:31PM (#29732853)
I'd also like to chime in on "effect size matters". After all, you don't need particularly large N to conclude that decapitation is going to be fatal.
Re:Experimental depression treatment is nearly 80% effective... by mlyle on Wednesday December 29, 2021 @09:34PM (#29732871)
Yes---

Small n studies are often the most exciting. If you get a p<0.01 effect in 10 people vs. 10000 people... the lower bound of the effect size is similar, and so for the same prior each study should change our belief by a similar amount... but the upper bound of effect size is much larger in the large study.

The only thing that messes this logic of mine up a bit is publication bias. There's a much larger chance that small studies sit on the shelf unpublished if there's no clear effect.