Re:Replication Controversy in Psychology
by droopyEyelids on Sunday August 03, 2014 @09:35AM
(#8127861)
But if you're not minimizing the confounding factors enough that the result can be repeated, your experiment failed. Your hypothesis has neither been provably confirmed nor denied. At that point you are, at best, still gathering evidence, and publishing results would be an error.
If you have more than one researcher administering a test in a stereotype threat experiment, that'll reduce the likelihood of that being the confound. If other studies (not replications, but their own experiments, with their own, different approaches to study the problem) agree with the first experiment, the effect is likely real.
I would also say that you're viewing the entire system far too antagonistically. Nobody goes into academic psychology to get rich off of it.