News for hackers. Stuff that matters.
Re:Experimental depression treatment is nearly 80% effective... by mlyle on Wednesday December 29, 2021 @09:34PM (#29732871)
Yes---

Small n studies are often the most exciting. If you get a p<0.01 effect in 10 people vs. 10000 people... the lower bound of the effect size is similar, and so for the same prior each study should change our belief by a similar amount... but the upper bound of effect size is much larger in the large study.

The only thing that messes this logic of mine up a bit is publication bias. There's a much larger chance that small studies sit on the shelf unpublished if there's no clear effect.

There are no comments on this comment yet.