News for hackers. Stuff that matters.
Re:Why Most Published Research Findings Are False by verisimi on Wednesday September 25, 2024 @01:35AM (#41643993)
The scientific method converges on the truth. But science need not.

If the foundational assumptions are wrong or impossible to challenge, time t can extend indefinitely. Additionally, it is surely possible that whole sections of science is waylaid and diverges from truth on account of funding, legislation, big personalities, etc.

Re:Why Most Published Research Findings Are False by DrNosferatu on Wednesday September 25, 2024 @02:36AM (#41644330)
But what is “truth”?
Re:Why Most Published Research Findings Are False by nolist_policy on Wednesday September 25, 2024 @04:29AM (#41645120)
Useful models that allow us to make predictions.
Re:Why Most Published Research Findings Are False by guardian5x on Wednesday September 25, 2024 @07:48AM (#41646257)
The models are just an approximation to the truth. The truth is objective reality itself.
Re:Why Most Published Research Findings Are False by pixl97 on Wednesday September 25, 2024 @11:45AM (#41648673)
Objective reality doesn't allow us to make predictions itself, it is an nonce. Unfortunately we don't have a time reversing machine to run entropy in reverse and see the thermodynamic truth. All we have is models, your consciousness being one of them.
Re:Why Most Published Research Findings Are False by karatinversion on Wednesday September 25, 2024 @05:53AM (#41645559)
To say of that which is, that is is, or of that which is not, that it is not
Re:Why Most Published Research Findings Are False by verisimi on Wednesday September 25, 2024 @06:14AM (#41645686)
Indeed. There is no independent arbitor. One can imagine that the collective, consensus answer is best, or not. If it is possible to steer that answer towards something that is beneficial to someone somewhere - why wouldn't vested interests do that?
Re:Why Most Published Research Findings Are False by akoboldfrying on Wednesday September 25, 2024 @06:22AM (#41645737)
>The scientific method converges on the truth.

There's actually quite a big assumption in here -- namely, that the truth is constant over time and throughout space. (This can possibly be weakened slightly, but that's the gist.)

I personally think the laws of physics probably are unchanging, and I certainly hope they are (because that means the scientific method converges). But whether they actually are is not only unknown, but a question that cannot be answered by empirical science.

Re:Why Most Published Research Findings Are False by ants_everywhere on Wednesday September 25, 2024 @08:43AM (#41646785)
This is an interesting point and one that physicists are aware of.

But from a technical perspective, the math is perfectly capable of describing theoretical universes where the laws of physics change in time or space. For example, where physical constants are smoothly evolving or manifolds that don't look the same in all directions.

The math can tell us what observations we'd expect in those situations, and so far we haven't observed anything to indicate we should relax those assumptions.

If we did observe that the laws of physics were changing, that observation would be considered science in the traditional sense. So it's not that "truth" is shifting, it's that "truth" is a family of equations indexed by some parameter rather than a single equation. That's a similar flavor to the jump from Newtonian physics to relativity.

If you're interested in this topic, a relevant key word is "cosmological principle": https://en.wikipedia.org/wiki/Cosmological_principle

Re:Why Most Published Research Findings Are False by SkyBelow on Wednesday September 25, 2024 @10:59AM (#41648277)
>There's actually quite a big assumption in here -- namely, that the truth is constant over time and throughout space.

The current models include these assumptions for the same reason they include any other assumptions, because models where these assumptions aren't included don't do any better a job explaining any experimental results. If new experimental data shows these assumptions fail in some cases, then the models can be updated to handle them, same as any other failure has been handled in the past. (Granted each step becomes computationally more complex, so eventually we might hit a limit where it is too complex for a human to understand well enough to operate on.)

Re:Why Most Published Research Findings Are False by guappa on Wednesday September 25, 2024 @06:58AM (#41645955)
Or stops at a local minimum :D
Re:Why Most Published Research Findings Are False by ants_everywhere on Wednesday September 25, 2024 @08:07AM (#41646439)
Yes this is a problem and it can (and has) lasted for centuries.

I think this is the best ways to talk about the difference between science as a process vs science as what people in white lab coats do.

People have a tendency to conclude that we should abandon science if something isn't quite right. It's better to think in terms of what will get us un-stuck from a local minimum/maximum.

Re:Why Most Published Research Findings Are False by ants_everywhere on Wednesday September 25, 2024 @08:52AM (#41646882)
> If the foundational assumptions are wrong or impossible to challenge, time t can extend indefinitely.

This is an important point, but fortunately nature has provided us with a solution. Namely that teenagers are defiant and look for ways to distance themselves from their elders.

This is Planck's principle that science advances one funeral at a time [0]

> A new scientific truth does not triumph by convincing its opponents and making them see the light, but rather because its opponents eventually die and a new generation grows up that is familiar with it ...

> An important scientific innovation rarely makes its way by gradually winning over and converting its opponents: it rarely happens that Saul becomes Paul. What does happen is that its opponents gradually die out, and that the growing generation is familiarized with the ideas from the beginning: another instance of the fact that the future lies with the youth. — Max Planck, Scientific autobiography, 1950, p. 33, 97

The biggest impediments have historically been multi-generational organizations whose power requires limiting access to science. Famously the centralized church in the time of Galileo. More recently the cigarette and oil industries. Things like big personalities and legislative priorities tend to have much shorter time scale and usually allow for science to ratchet forward generationally. Big personalities die, legislators turn over every few years in the best case or in a few generations in the worst case.

[0] https://en.wikipedia.org/wiki/Planck%27s_principle

Re:Why Most Published Research Findings Are False by marcosdumay on Wednesday September 25, 2024 @11:41AM (#41648640)
It's not only teenagers. Lots of people are defiant through their entire lives, and those people do disproportionately like to work in science.

Intra-generational power structures are a much larger impediment. Funerals take way too long to happen.

Re:Why Most Published Research Findings Are False by Jensson on Wednesday September 25, 2024 @10:24PM (#41653902)
> Lots of people are defiant through their entire lives, and those people do disproportionately like to work in science.

That is strange since to work in science today you have to be extremely compliant for close to a decade. Most people who aren't gets kicked out or removed in selection processes, what you have left is one of the most compliant parts of society.

Re:Why Most Published Research Findings Are False by analog31 on Wednesday September 25, 2024 @12:49PM (#41649335)
Remember that in Planck's time, and today, there was no widespread consensus about how science progresses.

Disclosure: Old person

Re:Why Most Published Research Findings Are False by SkyBelow on Wednesday September 25, 2024 @10:55AM (#41648240)
>time t can extend indefinitely

Isn't that generally what convergence means? At least in the math sense, we are talking about t at infinity, meaning that in any real world time limited application, there is always a gap.