News for hackers. Stuff that matters.
Re:About 40% of economics experiments fail replication surve... by forapurpose on Sunday September 16, 2018 @11:57PM (#18003097)
> We found a significant effect in the same direction as in the original study for 11 replications (61%); on average, the replicated effect size is 66% of the original.

EDIT: Similar results to the well-known psychology replication study of a few years ago:

Strictly on the basis of significance — a statistical measure of how likely it is that a result did not occur by chance — 35 of the studies held up, and 62 did not. (Three were excluded because their significance was not clear.) The overall “effect size,” a measure of the strength of a finding, dropped by about half across all of the studies. Yet very few of the redone studies contradicted the original ones; their results were simply weaker.

https://www.nytimes.com/2015/08/28/science/many-social-scien...

There are no comments on this comment yet.