News for hackers. Stuff that matters.
Re:Facebook said my article was false – now the fact-checker... by cogman10 on Wednesday December 29, 2021 @12:22PM (#29727029)
It honestly makes me really nervous for the future. There is a LOT of distrust in experts that I see across the internet (and here in HN).

While there are bad actors, consensus is generally going to guide you closer to the truth than fringe experts. What does the community of experts who have studied this say about it? Is it something generally accepted by the experts or is it something that most experts disagree with?

It is nearly impossible that an entire field of study will succumb to bias. Climate change is the poster child here. Where experts disagree isn't that it is happening and caused by man, they disagree about the degree that it will be a problem (With all of them agreeing it's a major issue). Yet, I've often seen it claimed that those experts are all biased and this fringe expert funded by Koch research is really the one to be trusted (which, shocker, finds we should be burning MORE fossil fuels!)

Re:Facebook said my article was false – now the fact-checker... by autokad on Wednesday December 29, 2021 @01:07PM (#29727646)
I worked first hand in a research group. the 'experts' are extremely political, and anything that doesn't fit their political agenda is ignored, and if the study/experiment doesn't fit their political agenda they keep trying or fudging the data until it does. I'll give you an example,

I noticed a map of obesity overlaps very well with a map of diabetes. high alcohol consumption mapped very well with the areas the prior map didnt correlate. in other words, in areas where obesity was not correlated with diabetes, there was high alcohol consumption. paper worthy or worth looking into? no. I lied to a different section of the group and said these were areas of increased correlation, and it wasn't alcohol but soda consumption. They immediately wanted to seek grants to write papers.

You can see how this leads to junk science. if you ignore things that dont fit your political agenda and only research things that fit your agenda, that's junk science. it gets worse because when the data doesnt suggest the political agenda pushed, they try to 'account' for other factors or re-run the study in a different way until it says what they wanted it to say. worse case, it doesnt get published.

The experts are not to be trusted.

Re:Facebook said my article was false – now the fact-checker... by colejohnson66 on Wednesday December 29, 2021 @01:09PM (#29727681)
Is that related to the “reproduction crisis” science is going through right now?
Re:Facebook said my article was false – now the fact-checker... by autokad on Wednesday December 29, 2021 @01:52PM (#29728362)
yes because results are jelly beaned. If you keep changing what to measure for success criteria until you get what you want, you are more likely reject the null hypothesis even though you should not have OR if you dont publish results that doesnt fit your political bias, the 1/20 ones that do get published and also incorrectly rejected the null hypothesis
Re:Facebook said my article was false – now the fact-checker... by nradov on Wednesday December 29, 2021 @01:02PM (#29727578)
Expert consensus has some value, but it's often too subject to inertia and fails to adjust fast enough to new evidence. Up until 1982 the medical experts told us that peptic ulcers were caused by stress and spicy food. Except that was totally wrong.

https://www.news-medical.net/health/Peptic-Ulcer-History.asp...

What else could they be wrong about today? Often when you really dig into consensus statements you find that they're based on a handful of old studies which don't really meet modern evidence based medicine criteria.

Re:Facebook said my article was false – now the fact-checker... by cogman10 on Wednesday December 29, 2021 @01:12PM (#29727723)
The problem I have with statements like these is they focus on the misses while ignoring hits.

Expert consensus says that washing hands prevents the spread of disease. It's been like that since the 1950s. Has that consensus been wrong?

What about the expert consensus that azithromycin is an effective treatment against (most strains of) streptococcus? Is that consensus wrong?

You are correct, expert consensus will be wrong at times and it will take a fairly large push and evidence to change course. However, for every example of the experts "getting it wrong" there are 100s if not 1000s where you are better off following the consensus. Further, as time goes on, the process of developing consensus improves itself. It looks for faults that lead to bad conclusions and corrects for those faults in future studies.

It is a truth that experts and their consensuses will be wrong. However, if I follow and accept what a strong expert consensus says about something in that field of study 99% or even 99.99% of the time, they will be right. Or said another way, if you make the claim that "This expert consensus is wrong" You'll be right 0.01% of the time and wrong 99.99% of the time. Unless you are an expert in that field of study and you have a bunch of very strong research backing the claim, you've got no footing to really go against the consensus.

Re:Facebook said my article was false – now the fact-checker... by nradov on Wednesday December 29, 2021 @02:36PM (#29729046)
I agree that expert consensus is more often right than wrong. However you have no scientific basis for claiming that they are right 99% of the time. You just made up that number. In fact the actual accuracy rate is unknown, and indeed unknowable.

My subjective impression is that expert accuracy rates vary widely by scientific field. High energy particle physicists might actually be hitting 99.99%. Psychologists and nutritionists might not even be at 50%. Epidemiologists are somewhere in the middle.

Experts lose credibility when they make sweeping recommendations based on flawed or limited research rather than remaining silent as they should. Once trust is lost it takes a generation to regain.

Re:Facebook said my article was false – now the fact-checker... by cogman10 on Wednesday December 29, 2021 @03:03PM (#29729310)
> However you have no scientific basis for claiming that they are right 99% of the time. You just made up that number. In fact the actual accuracy rate is unknown, and indeed unknowable.

> My subjective impression is that expert accuracy rates vary widely by scientific field. High energy particle physicists might actually be hitting 99.99%. Psychologists and nutritionists might not even be at 50%. Epidemiologists are somewhere in the middle.

All fair points that I don't really disagree with.

> Experts lose credibility when they make sweeping recommendations based on flawed or limited research rather than remaining silent as they should. Once trust is lost it takes a generation to regain.

I don't think it's quiet as binary. I agree, they should limit recommendations based on the data and be very open when "the data is limited and more information could change our recommendation".

But I don't think that means they need to be silent when data is limited, just careful with communication.

Health experts are in the worst position for this sort of thing. In a pandemic situation, data will simply be limited and action required to prevent lose of life. You can't just sit back and do nothing.

But, I'd agree that you need to be very open and frank about why you are taking actions and how confident you are that the actions you are taking will be effective. COVID hasn't been handled perfectly in that regard, but it could be worse.

As for trust and credibility, I think a major social issue we have is that we are quick to distrust experts over being wrong or mistepping on any given issue but for some reason we are extremely forgiving of religious leaders and politicians that repeat platitudes we agree with. I'm not advocating for blind trust in experts, but I wish it wasn't so reactionary, where any wrong statement causes people to lose all trust in expert credibility. That's not something I could control anyways.

Re:Facebook said my article was false – now the fact-checker... by nradov on Wednesday December 29, 2021 @03:44PM (#29729773)
Actually action is not required. In the medical field if you aren't legitimately confident about the effects of a particular action, both positive and negative, then it's better to sit back and do nothing (while conducting additional research).

"First, do no harm" is a fundamental principle of medical ethics. Unfortunately iatrogenic harm from over treatment is still a serious cause of injuries and deaths. The default should always be to do nothing unless there is clear and reliable evidence to support intervention. That applies equally to pandemics as to other situations.

https://www.nap.edu/catalog/9728/to-err-is-human-building-a-...

I understand that politicians might sometimes have to take rapid actions based on political factors. But don't deceive the populace by falsely claiming those actions are supported by scientific consensus.

Re:Facebook said my article was false – now the fact-checker... by clairity on Wednesday December 29, 2021 @02:59PM (#29729274)
given that knowledge is practically infinite (bounded only by the expanse of the universe), you'd actually expect the correctness of scientific consensus to asymptotically approach 0. that is, we're waaaaaay more wrong than right, and waaaaay more often, before we get it right, especially as knowledge gets more fractally intricate and expansive.
Re:Facebook said my article was false – now the fact-checker... by cogman10 on Wednesday December 29, 2021 @03:18PM (#29729483)
That'd only be true if expert consensus covered all knowledge. It doesn't, nor does it opine on all possible knowledge.

Saying correctness approaches 0 because knowledge is effectively infinite would be like saying our ability to do math correctly is 0 because there are an infinite amount of numbers. Or, that our ability to write correct software is 0 because there are infinite possible programs.

Re:Facebook said my article was false – now the fact-checker... by clairity on Wednesday December 29, 2021 @06:00PM (#29731250)
no, those are not analogous at all. knowability is literally a subset of all knowledge, which pushes into a void that expands faster than we can enumerate. it's hubris to think otherwise.
Re:Facebook said my article was false – now the fact-checker... by cogman10 on Wednesday December 29, 2021 @06:25PM (#29731473)
> you'd actually expect the correctness of scientific consensus to asymptotically approach 0

Scientific consensus correctness is calculated as true assertions / all assertions.

If we stopped making assertions, today, the scientific consensus correctness would be fixed at whatever level it is at. The amount of knowledge that hasn't been studied has no bearing on the correctness of scientific consensus. That's a number that is finite with a denominator squarely fixed by the number of assertions that happen as human knowledge expands.

The assertion 1 + 1 = 2 will always be true. If that was the only assertion the scientific community ever made and had consensus over then they'd be at 100% correctness. It doesn't matter that you can also calculate 1 + 2, or 3 + 5, or an infinite number of numerical combinations. The denominator is the assertions, not the unasserted assertions. It doesn't matter that knowledge is "fractile" or whatever. Because, assertions by the scientific community are pretty much always couched as "Given the current data, this model fits best". Newtonian physics isn't "incorrect" it's incomplete. This is the same for most knowledge with that "fractile" understanding.

The only way you approach 0 is if our fundamental understanding of reality is completely fundamentally flawed, but then, that'd be an unknowable knowledge.

Re:Facebook said my article was false – now the fact-checker... by clairity on Wednesday December 29, 2021 @06:41PM (#29731599)
that's trying to artificially constrain knowledge in a way so that your prior assertion is true (reminiscent of the incompleteness theorem). that's a common way that people become simultaneously self-certain and wrong.

scientific consensus has no hope of outrunning even what humans in general know, let alone every scientific conjecture ever made, most of which aren't disproven, but rather merely discarded. and all that is a tiny speck next to everything that's within reach of human knowledge, which is miniscule next to everything that could ever be known but is forever beyond our reach. it really does approach 0 at the limit.

Re:Facebook said my article was false – now the fact-checker... by cogman10 on Wednesday December 29, 2021 @07:03PM (#29731769)
I'm not "constraining knowledge" I'm not saying it isn't theoretically infinite. I'm saying that the amount of knowledge has no barring on whether or not an assertion is true.

Further, the scenario of this entire thread is about current and future scientific consensus, not past consensus. The fact that protoscience said that that you need to balance the 4 humors to cure illness does not affect current scientific consensus which soundly rejects that notion.

The number of assertions we have scientific consensus on is finite. The number of those assertions which are true is a finite number. The infinite nature of knowledge does not change that ratio because, again, we aren't making assertions about everything that is knowable.

The entire point of this conversation is "What is more likely true, what the experts say or something else?". You are making the claim that because scientists don't know what every atom in the sun is doing, they can't correctly say that the sun will rise in the morning. Because, their knowledge of the sun is an infinitesimally small percentage of everything there is to know about the sun.

My point is, scientists aren't making assertions about what every quark in the sun will do. They aren't making assertions about the temperature of every square inch of the sun. The assertions they are making are far more broad and, shocker, likely 90+% true. Which circles back to my main point. If an expert tells you "The surface of the sun is roughly 6000C" That's a correct statement.

If you aren't going to address this in your next comment then don't bother because I'm done with this. You are being purposefully obtuse.

Re:Facebook said my article was false – now the fact-checker... by rajin444 on Wednesday December 29, 2021 @01:29PM (#29727982)
> The problem I have with statements like these is they focus on the misses while ignoring hits.

That's how trust works. It only takes 1 miss to lose it.

The issue isn't that experts are wrong or change their stance when the data changes. That isn't a problem and is exactly how things should work.

The issue is when politicians and leaders treat "expert opinion" as settled truth. Our decisions and policies need to be crafted knowing that experts are wrong and the situation changes when the data changes. Instead, politicians and leaders hold up expert opinion as settled and let the blame fall on the scientists, researchers, etc. when they "miss". If their work was not co-opted by politicians there would be no issue.

Re:Facebook said my article was false – now the fact-checker... by seoaeu on Wednesday December 29, 2021 @02:03PM (#29728553)
> That's how trust works. It only takes 1 miss to lose it.

No, that’s only how things work when you are looking for a pretense to ignore expert advice.

Re:Facebook said my article was false – now the fact-checker... by rajin444 on Wednesday December 29, 2021 @03:14PM (#29729424)
How am I supposed to judge expert advice if I lack the technical knowledge? Blind trust?
Re:Facebook said my article was false – now the fact-checker... by cogman10 on Wednesday December 29, 2021 @03:27PM (#29729557)
What else can you do? Really? How can you trust or distrust expert advice without the technical knowledge?

Most of the reasons for distrust I've seen have basically boiled down to "I don't like what the expert is saying" or "They were wrong once, obviously all experts are wrong about everything".

Re:Facebook said my article was false – now the fact-checker... by rajin444 on Wednesday December 29, 2021 @06:11PM (#29731354)
It’s definitely a soft skill, but roughly for me it’s: - assumes good faith - doesn’t attempt to control others - doesn’t show disdain of their out group

Obviously knowing somebody personally makes this much easier.

Re:Facebook said my article was false – now the fact-checker... by tiahura on Wednesday December 29, 2021 @01:25PM (#29727906)
“Expert consensus says that washing hands prevents the spread of disease. It's been like that since the 1950s. Has that consensus been wrong?”

WRT Covid, yes that advice was wrong and has been abandoned as Covid isn’t spread by surface transmission.

Re:Facebook said my article was false – now the fact-checker... by ErikVandeWater on Wednesday December 29, 2021 @12:45PM (#29727341)
Trust in scientists is too high when they keep pumping out studies that don't replicate, and don't publish the original data and methods used to reach conclusions.

I wholly trust science that independently replicates and the fact that it's missing from the process means much of what we see is less than wholly trustworthy.

Re:Facebook said my article was false – now the fact-checker... by cogman10 on Wednesday December 29, 2021 @01:01PM (#29727561)
Not all fields of science are created equal. Whether or not studies are replicated or data is available will depend entirely on the field of study.

Certainly, a lot of the social sciences and "soft" sciences have a fair bit of replication/data problems. That said, the biomedical, environmental, geologic, and chemical sciences by and large have really solid data and repeats of that data. The areas of sciences we have a harder time controlling for are those where it'd be unethical to get better data and examples (nutritional science, for example).

There are far too many fields of study to lump all science into the same bucket and call it all untrustworthy.

A bigger problem is that scientific journalism treats every study as being equal. When, in fact, some studies are far better than others and carry a much larger weight of truth.

Re:Facebook said my article was false – now the fact-checker... by fallingknife on Wednesday December 29, 2021 @01:06PM (#29727644)
> Not all fields of science are created equal.

But FB, and other platforms, treat them as if they are when making their decisions on what to censor. FB even trusts so called "independent fact checkers," who don't even claim to be scientists and write mostly on political topics, to act as arbiters of truth.

> A bigger problem is that scientific journalism treats every study as being equal.

And it's these journalists that FB is relying on for its determination of fact, not the actual scientists.

Re:Facebook said my article was false – now the fact-checker... by umvi on Wednesday December 29, 2021 @01:52PM (#29728377)
> It is nearly impossible that an entire field of study will succumb to bias

It's happened before, especially when a select few command the majority of the field's grants/publications. If you are interested in how this could happen, here's an example of where basically the entirety of the Alzheimer's disease research field of study succumbed to bias:

https://www.statnews.com/2019/06/25/alzheimers-cabal-thwarte...

as well as the HN discussion on it: https://news.ycombinator.com/item?id=21911225

Re:Facebook said my article was false – now the fact-checker... by quinnjh on Thursday December 30, 2021 @03:38AM (#29734897)
Experts have spent more time tuning their biases. If someone claims to be free of bias then they dont understand training sets and inheritance.
Re:Facebook said my article was false – now the fact-checker... by fallingknife on Wednesday December 29, 2021 @01:01PM (#29727568)
Then stop censoring. Look at what happened in this post. Experts said X, the author said Y, and Y was censored because it disagreed with the experts. Later the experts admitted that X was incorrect. Of course, the experts, who ended up being wrong faced no consequences, while the author who ended up being right was censored. The experts are essentially a privileged class whose opinions are considered to be true by default, and when they get things wrong, it is assumed that this is just a good faith mistake, and forgiven. Everybody else is assumed to be wrong by default, and spreading politically motivated misinformation. When they are right it is assumed to be a fluke and swept under the rug. In this environment the only logical response is to mistrust the appointed "experts." If they are what they say they are let them defend their point against all challengers.
Re:Facebook said my article was false – now the fact-checker... by sutuplesu on Wednesday December 29, 2021 @02:04PM (#29728590)
Facebook's actions keep being cast as if there is a completely open, level, neutral field that the censorious fact checkers are now distorting. But that's not the starting point. Facebook already has its thumb -- if not both hands and an elbow! -- on the scale, as far as what content is dispersed. The view is distorted to begin with, by Facebook choosing what is promoted and what is not.

They may not be doing a particularly good job un-distorting it, but it's not a choice between pure and free exchange of information and censorship. It is between whether Facebook is going to manipulate in both directions -- promoting and taking down -- or just one.

(Note that I don't think either of these choices are particularly good. I would prefer that Facebook did neither.)

Re:Facebook said my article was false – now the fact-checker... by nescioquid on Wednesday December 29, 2021 @01:46PM (#29728271)
> Then stop censoring.

And stop dissembling. For instance, Fauci's early statements on mask-wearing were calculated to preserve the supply of N95 masks for medical personnel. However laudable the intent, it betrays what I imagine is an endemic world-view that the masses must be manipulated, rather than dealt with honestly.

This morning, an NPR report about the new CDC quarantine guidelines acknowledged criticisms/allegations of corporate lobbying for the policy change and internal fears of staffing for critical services, which was followed-up by a "follow the science" platitude.