Re:Machine Learning Reproducibility Checklist [pdf]
by samcodes on Friday December 27, 2019 @10:48AM
(#21891940)
Eliezer Yudkowsky wrote a lot about (many things, including) refining the scientific method in Rationality [0]. IIRC, his point is that the scientific method puts no constraints on what hypotheses you test. He thinks a more orderly search of hypothesis space is preferable.
[0] https://www.readthesequences.com/