- we want to be able to understand and predict things
- we can come up with various explanations that might be able to do this
- if our explanation fails to predict an observation, it is wrong and we need to update or replace it
If you're doing that, you're doing science.
" Guess -> Compute Consequences -> Compare to Nature / Experiment / Experience / Observation
If it disagrees with experiment, it's wrong. In that simple statement is the key to science."
I would say some of the ancients did science too, to the best of their knowledge.
This passage reminds me of how neural nets learn and often fail to generalise.
Somewhat disagree. That particular research programme must still have reproducible experiment as a unit. A million irreproducible experiments will generate exactly zero knowledge.
science has told us so far that masks might help at the margins, but hasn’t proven it, which indicates it probably shouldn’t be counted on as a primary mitigative measure, but the public signaling value is just too irresistible for the believers (transmission principally happens in private where social norms oppose mitigative measures).
in other words, expertise is narrow, and treatment experience isn't research.
Can you give an example of something that isn't reproducible but was still true?
He excluded values to reduce his error (seems like), but that doesn't make the experiment non-reproducible. You can do the same experiment today and get an approximate value for e.
Will you get the exact same results as Millikan? Of course not. But that's not what reproducible means.
Reproducible means that if you follow the method outlined by Millikan, you should get an approximate value for e. This is indeed the case, so the experiment is reproducible.
A non-reproducible experiment would be one where you follow Millikan's method but get something that is nowhere close to being a value for e.
ETA: I encourage the interested to read https://plato.stanford.edu/entries/scientific-reproducibilit... which delves into these semantic issues.
Not every experiment needs to be reproducible in exactly the same way, just like not every study needs to be double-blind. You need to interrogate the reason the experiment exists in the first place.
I guess another way of saying it is this: even though Millikan's actual final result is not reproducible because he fudged his numbers, the scientific method employed in the experiment is valid, which is really all you need in the case of that experiment.
The problem with medicine / psychology / other less "hard" research is that in many instances it doesn't matter if the method is reproducible if the results are not. If the goal is to show that eating pancakes cause depression the result is actually all that matters.
Thanks for the link, I will give it a read.
This link clearly talks about reproducible results, not reproducible data.
Wherever there is some degree of randomness, we would not expect to get the same data, but we would expect to draw the same conclusion.
See also: the Mendelian paradox - it is sometimes argued that Gregor Mendel's results were too perfect, and yet he is honoured as the father of genetics.
To me it seems you're conflating reproducibility with insight. Of course insight is also key, and it may be useful even if it's wrong, as long as it causes others to recursively have new insights and create hypotheses and do experiments that eventually turn out to be true.
Of course there is an epistemological distinction here between a thing that cannot be reproduced by its nature vs. one that cannot be reproduced by societal norms.
As a side note, I'd push back against the idea that replicability is the key ingredient of science: it's neither necessary nor sufficient to discover scientifically "true" knowledge, though it's definitely a nice to have. Plenty of important measurements have been made confirming theories we see as true today (or true enough) that turn out to have been irreproducible, plagued by experimenter bias, or even outright fraudulent. But it's a particular research programme, embedded in a social context, that generates knowledge, not a single reproducible experiment.