News for hackers. Stuff that matters.
Re:The Probability and Statistics Cookbook by stewbrew on Tuesday November 29, 2016 @04:23PM (#13066390)
You cited Gigerenzer, Neyman, Pearson as if they opposed the concept of power. Fisher might be in a different boat but he also claimed that smoking doesn't cause lung cancer, so he probably wasn't always right. :-)

Sample size, effect size & power are related concepts in the context of power analysis -- see also Cohen's "A primer on power", which is available on the Internet. The concept of power has nothing to do with "degrees of evidence" or vague hypotheses.

Re:The Probability and Statistics Cookbook by nonbel on Tuesday November 29, 2016 @04:34PM (#13066442)
>"You cited Gigerenzer, Neyman, Pearson as if they opposed the concept of power."

Sorry for the miscommunication. The point is that power is a Neyman/Pearson concept, Fisher said it didn't make sense. On the other hand a gradient of evidence is a Fisherian concept, Neyman/Pearson said that didn't make sense.

What people have been teaching as stats is a mismash of the two that makes sense to no one who thinks these types of things through. Gigerenzer reviews this strange phenomenon and offers some entertaining commentary, it is a decent starting point.

Re:The Probability and Statistics Cookbook by nonbel on Tuesday November 29, 2016 @04:38PM (#13066467)
>"The concept of power has nothing to do with "degrees of evidence" or vague hypotheses."

Yes it does. To properly assess the probability of incorrectly failing to reject a hypothesis you need to know how likely the data would be under various rival hypotheses. This depends on the precision of the various hypotheses. This is explained by Fisher in my original ref.

Re:The Probability and Statistics Cookbook by nonbel on Tuesday November 29, 2016 @04:57PM (#13066585)
You may also want to check out figure 2 of this paper which further illustrates the relationship between a statistical hypothesis and the research hypothesis: http://rhowell.ba.ttu.edu/Meehl1.pdf
Re:The Probability and Statistics Cookbook by justifier on Wednesday November 30, 2016 @09:52AM (#13071170)
> Ten years later, I wrote at greater length along similar lines (Meehl, 1978); but, despite my having received more than 1,000 reprint requests for that article in the first year after its appearance, I cannot discern that it had more impact on research habits in soft psychology than did Morrison and Henkel.

is the author using a null value to inform this perception?

Re:The Probability and Statistics Cookbook by nonbel on Wednesday November 30, 2016 @04:16PM (#13074763)
Doesn't sound like it. It sounds like Meehl is giving an order of magnitude estimate. He is saying that it is his impression that both Morrison & Henkel's paper and his own seemed to have little effect on practice.

Clearly he doesn't think it had exactly zero effect, since it affected him!

Re:The Probability and Statistics Cookbook by justifier on Wednesday November 30, 2016 @06:26PM (#13075638)
assuming 1000 reprints somehow implies there should be a discernible 'impact on research habits' seems like an example of what your referenced Figure 2(o) calls 'Estimating parameters from sample'

(o) http://rhowell.ba.ttu.edu/Meehl1.pdf

Re:The Probability and Statistics Cookbook by nonbel on Wednesday November 30, 2016 @07:01PM (#13075835)
You have it reversed.

"Estimating parameters from sample" (on the right) would be his observation that there was little discernible effect. Thinking that 1000 reprints of the paper would have a larger effect on practice would more correspond to "theory" (on the left), although that is a pretty vague one.

Re:The Probability and Statistics Cookbook by justifier on Wednesday November 30, 2016 @09:23PM (#13076671)
but where does the 1000 figure come from? it reads arbitrary