Re:Scientists Edge Closer To Lab Test For Chronic Fatigue Sy...
by carbocation on Monday July 31, 2017 @07:15PM
(#14896684)
Right. My point is actually that they're doing an FDR within each group, not across the whole study. So, the adjusted P values are accurate within each group, but to look globally, you either need to then Bonferroni or re-perform the FDR globally. I'm not saying that my point is in disagreement with yours, by the way, I'm just trying to clarify that my point is independent of whether they had done in-group FDR or in-group Bonferroni.
I actually built an online FDR calculator previously, since I enjoy the topic so much: https://tools.carbocation.com/FDR
Nevertheless, thank you for calling this out. There is way too much p-hacking in science, especially biology.
[63] Benjamini Y, Krieger AM, Yekutieli D (2006) Adaptive linear step-up procedures that control the false discovery rate. Biometrika 93:491–507.