Re:Potential fabrication in research threatens the amyloid t...
by shusaku on Thursday July 21, 2022 @09:16PM
(#32187333)
To me this is why the emphasis on “reproducibility” is misguided. You might end up failing because you lack the technical capability. Conversely, you might “succeed” by making a mistake. We should be focusing on coming up with new ways to test the same hypothesis.
[ Parent
| on HN ]
Re:Potential fabrication in research threatens the amyloid t...
by vlovich123 on Friday July 22, 2022 @02:16AM
(#32189097)
The null hypothesis tells us that if we can reproduce repeatedly and reliably then we can actually use even relatively small number of reproductions to raise the net significance of the result (which also diminishes the ability for fraud to work as it requires a larger conspiracy instead of people just accepting people at their word).
If you think reproductions have failed then it’s on you to try to have a cogent explanation for why if you’re personally motivated by a belief that the experiment is actually valid.
The particle physics folks also have a different approach these days where they blind the ability to see results and do multiple cross checks of each other’s results to validate the data (because the underlying experiment is so expensive to run). That can also work in theory although hard to say what the success rate of that approach is just yet.
Re:Potential fabrication in research threatens the amyloid t...
by ImPostingOnHN on Friday July 22, 2022 @02:50AM
(#32189270)
that is what multiple reproductions are for
indeed, the initial experiment is not immune to such concerns, and might itself have succeeded by making a mistake or failed because it lacked the technical capability