News for hackers. Stuff that matters.
Re:Warning Signs in Experimental Design and Interpretation (... by rwilson4 on Monday January 07, 2019 @04:45PM (#18850493)
This is all good info; I'll add that a confidence interval on the effect size[0] is more informative than a p-value. (This is subtly different than a confidence interval on the response in each group, which is discussed in the article: Warning Sign I5: taking p too seriously.)

[0] "It's the effect size, stupid" https://www.leeds.ac.uk/educol/documents/00002182.htm

Re:Warning Signs in Experimental Design and Interpretation (... by b_tterc_p on Monday January 07, 2019 @06:19PM (#18851324)
I like this. But...

“As a further example he states that the difference in IQ between holders of the Ph.D. degree and 'typical college freshmen' is comparable to an effect size of 0.8.”

Boy, there is a lot to unpack there.