But a perversion it still is. It is eminently scientific to simply document and even publish an inexplicable observation, and only later hope that somebody can incorporate it into a testable theory.
To watch a putative scientist discard evidence because it has no theory with it boggles my mind, but even here on HN I've seen articles about papers getting rejected for this reason in the last year, so it's a real problem even today.
It's hard to understand how a scientist could be arrogant enough to dismiss legitimate evidence simply because the underlying mechanism isn't understood.
There are often lots of confounding factors - in the SIDS case, much of the decrease in SIDS rate can be attributed to changes in factors (continuing the decrease from before the "back to sleep" campaign, generally safer sleep areas, changes in cause-of-death coding, etc.) https://naturaltothecore.wordpress.com/2013/02/14/revisiting...
When you don't have the correct theory or mechanism, it's easy to do the wrong thing - like when the British navy thought acidity prevented scurvy and shifted from using lemon juice to more-acidic lime juice processed with copper tubing that destroyed the vitamin C... http://en.wikipedia.org/wiki/Scurvy
Rather than just following a statistical anomaly, you need to devise and perform tests that will invalidate your theory, as was done with the other theories (e.g., the priest bell in the article). This is perilous when people's lives or global economies are at stake, and so anomaly hunting and cargo cult science can persist in high-stakes, difficult to test environments.
Also, I'd happily set the bar higher on correlations to be reported in this manner... then again, I consider 0.05 to be a mistake anyhow that should simply be rectified as that has been concretely demonstrated to not be enough, IMHO.
Contemporary reaction to Ignaz Semmelweis
Semmelweis's critics claimed his findings lacked scientific reasoning. The failure of the nineteenth-century scientific community to recognize Semmelweis's findings, and the nature of the flawed critiques outlined below, helped advance a positivist epistemology, leading to the emergence of evidence-based medicine. [1]
[1] http://en.wikipedia.org/wiki/Contemporary_reaction_to_Ignaz_...