It's more like "hypothesis" -> "experiment" -> "uh, this is kind of weird" -> "changes hypothesis to fit the data" -> "take some more data" -> "huh... here's this cool thing unrelated to any of my other hypotheses" -> "switches topic to something more viable".
Science more than just a collection of facts, is a description of a set of experimental processes that recreate those facts. Which is where the authority-lessness power of it comes from.
I don't think the scientific method (in the sense of hypothesis->experiment->observation->theory) has anything to do with reproducibility. Frankly, I am not even sure it is necessary for good work, whether it is in ML/DL or in an established basic science. Scientific method is definitely not how most practitioners experience doing research.
Personally, I would count reproducibility as a fairly important part of the scientific method, as it demonstrates you've achieved the fundamental requirement of understanding your experimental setup.
Without very detailed understanding of your experiment, the experiment isn't scientific, so by extension I would claim that the GP's "scientific method" isn't scientific.
There is a longer discussion of this issue, with references, in the Stanford Encyclopedia of Philosophy: https://plato.stanford.edu/entries/scientific-method/#SciMet... It is especially worth reading if you believe that trial and error is against the scientific method.
The arguments were that in ML/DL, experiments are run at large scale without hypothesis, with radical empiricism in a trial and error fashion which is against Scientific Method i.e. Hypothesis, Experiment, Observation, Theory.
[1]https://soundcloud.com/theeconomist/babbage-ai-the-end-of-th...