News for hackers. Stuff that matters.
Re:How Should We Critique Research? by randcraw on Friday April 16, 2021 @05:44PM (#26839391)
Replicability shows that your method leads to consistent results, not that your hypothesis correctly explains the cause of those results. Yes, your intervention did provoke the causal chain into action, but it may not necessarily have correctly identified or thoroughly characterized the component you identified as the trigger. Your method may work great but only under the perverse set of conditions you happened to explore.

Conversely, if your method fails to drive the desired outcome, your hypothesis could still be correct, just incomplete. Maybe your perturbation of the chemical reaction didn't quite reach the activation energy. Or maybe other essential components in the mechanism were overlooked, given the set of conditions you happened to explore.

Complex black box systems like the brain are notoriously perverse in reproducibly giving up their secrets, even when your hypothesis is correct and your method robust.

There are no comments on this comment yet.