Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on p-Hacking and False Discovery in A/B Testing. Parent comment
1. Data collection is expensive (time or money)
2. Keeping with the status quo in the presence of new evidence is problematic (withholding a promising new drug)
3. Continuing with the experiment in the presence of new evidence is problematic (the new drug is hurting people)
Absent one of those features, it's probably not worth the added complexity.
There are no comments on this comment yet.
1. Data collection is expensive (time or money)
2. Keeping with the status quo in the presence of new evidence is problematic (withholding a promising new drug)
3. Continuing with the experiment in the presence of new evidence is problematic (the new drug is hurting people)
Absent one of those features, it's probably not worth the added complexity.