News for hackers. Stuff that matters.
Re:Researchers to retract landmark Alzheimer's paper contain... by kristianp on Wednesday June 05, 2024 @10:44PM (#40592884)
> published in Nature in 2006

So around 18 years ago. That’s a long time for researchers that believed in this papar's conclusions to be going down the wrong rabbit hole. What a huge waste of effort and the lives of those with Alzheimer's.

Re:Researchers to retract landmark Alzheimer's paper contain... by wang_li on Wednesday June 05, 2024 @11:12PM (#40593045)
This kind of fraud should carry a prison sentence.
Re:Researchers to retract landmark Alzheimer's paper contain... by datahack on Thursday June 06, 2024 @12:11AM (#40593396)
Absolutely. It’s not just a bad path, it’s taken researchers down a road that robbed approaches that could have helped people of resources because they lied.
Re:Researchers to retract landmark Alzheimer's paper contain... by hangonhn on Thursday June 06, 2024 @12:53PM (#40599639)
I wonder what the effects on retractions would be though. Some researchers might go down fighting or refuse to cooperate with investigators.
Re:Researchers to retract landmark Alzheimer's paper contain... by docbrown on Thursday June 06, 2024 @12:52AM (#40593631)
Retracted and sham papers is actually a major problem. Estimated 10,000 papers were retracted in 2023 (https://www.theguardian.com/science/2024/feb/03/the-situatio...) and that is thought to be only a small percentage.
Re:Researchers to retract landmark Alzheimer's paper contain... by rowanG077 on Thursday June 06, 2024 @07:13AM (#40596041)
That's kinda misleading. Not every retracted paper contains doctored results. There just a ton of mistakes as well.
Re:Researchers to retract landmark Alzheimer's paper contain... by eviks on Thursday June 06, 2024 @09:00AM (#40596857)
this isn't a big deal since no one reads most of those papers, it's mostly invisible sacrifice to the metrics gods. Very prominent papers like the one discussed, on the other hand, have much bigger consequences
Re:Researchers to retract landmark Alzheimer's paper contain... by btilly on Thursday June 06, 2024 @01:47PM (#40600311)
Some other fraud in the same subfield lead to an amoral douchebag becoming President of Stanford, where he destroyed the campus culture (read https://www.palladiummag.com/2022/06/13/stanfords-war-on-soc... to verify) and then supported DEI run amok (read https://www.insidehighered.com/news/2023/01/11/amid-backlash... to see some of the fallout from that).

This is in addition to wasting a big chunk of the billions spent each year on Alzheimer's research on false leads (see https://www.alz.org/news/2024/congress-bipartisan-funding-al... for a source on the billions).

Yes, very serious consequences indeed. (Note, I did my best to back up my statements with high quality unbiased factual references. Please read them before disagreeing with my description of the result.)

Re:Researchers to retract landmark Alzheimer's paper contain... by marginalia_nu on Thursday June 06, 2024 @09:50AM (#40597369)
Not everything gets retracted either. There's a surprisingly deep rot in many parts of science. There are strong incentives to publish, and a lot of the methods you can use to inflate statistical significance (i.e. p-hacking) are hard to distinguish from publication bias and other innocent explanations for falling outside of statistical expectations.

Preregistration might help, but it doesn't really address the misaligned incentives that are at the heart of academic fraud.

Re:Researchers to retract landmark Alzheimer's paper contain... by nextos on Thursday June 06, 2024 @12:01PM (#40599021)
Even articles that publish legit findings tend to embellish data. I do this for a living, I often try to reproduce prominent results, and I regularly see things that are too good to be true. This is bad because it pushes everyone to do the same, as reviewers are now used to seeing perfect and pristine data.

I have been asked to manipulate data a few times in my career. I have always refused, but this came at the cost of internal fights, getting excluded from other projects for being "too idealistic", or missed promotions. Incentives are just perverse. Fraud and dishonesty are rewarded, pretty depressing.

Re:Researchers to retract landmark Alzheimer's paper contain... by thwarted on Thursday June 06, 2024 @12:57PM (#40599699)
Tragedy of the Commons Ruins Everything Around Me.

Everyone wants answers, so anyone that provides an answer is elevated, independent of if the answer is right or not. To wit: the current AI push.

Clips from The Big Short surfaced in my YouTube feed recently, and they way you worded this reminded me of the scene with the rating agency.

Is scientific research and publishing headed for it's own CDS/MBS-esque implosion?

Re:Researchers to retract landmark Alzheimer's paper contain... by nextos on Thursday June 06, 2024 @05:10PM (#40602460)
I think academic research is becoming very inefficient, and traditional Academia might eventually become stagnant. If you don't play the game I described above, it is really hard to stay afloat. I guess industrial labs, where incentives are better aligned, might become more attractive. I have seen lots of prominent scientists moving into industrial labs recently, which would be something hard to imagine even a few years back.
Re:Researchers to retract landmark Alzheimer's paper contain... by RicoElectrico on Thursday June 06, 2024 @01:30PM (#40600119)
Thank you for doing the right thing.
Re:Researchers to retract landmark Alzheimer's paper contain... by schmidtleonard on Thursday June 06, 2024 @01:30PM (#40600123)
Yep. Worse, p-hacking can be done by accident. I mean, the term implies intent, but a dogshit null hypothesis is problematic regardless of whether it is dogshit on purpose or merely due to lack of skill on the part of the researcher. Either way, it pumps publication numbers and dumps publication quality. If 100% of researchers were 100% honest, we would still see this effect boost low-quality research.
Re:Researchers to retract landmark Alzheimer's paper contain... by blackbear_ on Thursday June 06, 2024 @09:53AM (#40597398)
That number alone doesn't say much. Yes it sounds like a lot in absolute terms, but consider that four million papers were published in 2023 alone, and a bit less than 70 millions since 1996 [1].

[1] https://www.scimagojr.com/worldreport.php

Re:Researchers to retract landmark Alzheimer's paper contain... by scotty79 on Thursday June 06, 2024 @01:23PM (#40600043)
Maybe retraction is something that should be something done in competitive fashion with negatve points awarded to researchers, universities and journals.
Re:Researchers to retract landmark Alzheimer's paper contain... by p00dles on Thursday June 06, 2024 @11:32PM (#40605052)
I’m 100% in agreement that there is a massive reproducibility crisis in science and that the publish-or-perish model is broken.

But, for completeness, paper retractions can happen for many reasons, not all of them nefarious, though it could be that most retractions are from authors trying to game the system and getting called out. For example, if the terms of using a certain data set change, you could be required to retract your paper and remove that data from the analysis.

Re:Researchers to retract landmark Alzheimer's paper contain... by nxobject on Thursday June 06, 2024 @01:26AM (#40593817)
Not only effort: millions and millions of public and private dollars wasted on followup research on a false premise, all so that an author could get citations. What a cost.
Re:Researchers to retract landmark Alzheimer's paper contain... by xnickb on Thursday June 06, 2024 @02:29AM (#40594194)
Playing devil's advocate: perhaps the authors strongly believed in the method but have failed to produce strong enough evidence. Then the goal was to renew financing in hopes of getting somewhere with the research, not to just get citations.

This of course is pure speculation

Re:Researchers to retract landmark Alzheimer's paper contain... by akoboldfrying on Thursday June 06, 2024 @02:40AM (#40594268)
I think the point you're making is that there need not have been any malicious intent, and I accept that, but I don't really consider this a devil's advocate position, since strongly believing something will work is still not grounds enough to lie about outcomes.
Re:Researchers to retract landmark Alzheimer's paper contain... by gorlilla on Thursday June 06, 2024 @03:19AM (#40594483)
Fraud is still fraud no matter what color you paint it.
Re:Researchers to retract landmark Alzheimer's paper contain... by nxobject on Thursday June 06, 2024 @03:32AM (#40594567)
I'm sympathetic to that: the pressure to have produced results must have been very, very heavy.
Re:Researchers to retract landmark Alzheimer's paper contain... by misnome on Thursday June 06, 2024 @04:25AM (#40594935)
I don't think "Fraud" counts as a devil's advocate position?
Re:Researchers to retract landmark Alzheimer's paper contain... by nkrisc on Thursday June 06, 2024 @06:20AM (#40595721)
What’s the difference?
Re:Researchers to retract landmark Alzheimer's paper contain... by chrisBob on Thursday June 06, 2024 @11:57AM (#40598957)
Not so bad because they were just trying to secure funding that might have gone to research not based on fraud?
Re:Researchers to retract landmark Alzheimer's paper contain... by rybosworld on Thursday June 06, 2024 @01:15PM (#40599919)
It's really not an excuse. This has directly led to decades of wasted time/money/effort searching for a cure of a very prevalent disease.

It does lend to an interesting thought experiment, though.

Imagine the researchers were right after all. They just needed more time, and so they faked some results. We might have ended up with an underdog/feel-good movie about how the researchers bravely persevered in spite of the drying up of their funding.

Re:Researchers to retract landmark Alzheimer's paper contain... by tommiegannert on Thursday June 06, 2024 @02:14AM (#40594085)
Google Scholar says it's been cited 3,455 times. (Having a quick look at the top three results showed the paper was cited together with other papers in the same area, though.)

https://scholar.google.com/scholar?cites=1621513420842042156...

Re:Researchers to retract landmark Alzheimer's paper contain... by zosima on Thursday June 06, 2024 @04:23AM (#40594925)
This paper is certainly shameful.

But one should not exaggerate the impact it had. The strongest support for the amyloid hypothesis of Alzheimer's comes from multiple sources of evidence that are completely unrelated to this paper.

Re:Researchers to retract landmark Alzheimer's paper contain... by mike_hearn on Thursday June 06, 2024 @04:39AM (#40595013)
The problem is we don't know how many of those other lines of evidence are also fraudulent.

What we do know is that finding academic fraud is like shooting fish in a barrel. It's way too easy even for totally unfunded volunteers. The situation in science right now is reminiscent of the situation in computer security circa 1999. Back then there were so many easily exploited RCE vulns in foundational infrastructure that "hacked by teenagers" became a TV trope. Almost anyone could sit down and find a way to hack into a network without much effort. Vendors engaged in a lot of screaming and denial, sometimes even attacking the people who found exploits for them.

But, the industry changed. White hats became widespread, companies hired those ex-teenage hackers in their thousands. They put every employee through trainings. Then when that wasn't enough they started paying out millions in bug bounties, buying sandboxing companies (like Google did for Chrome) and more. Companies did this because bad security was hurting their reputations and in a competitive market that is an exploitable weakness. It was a form of self defense.

Academic science is excluded from market mechanisms by legal fiat, supposedly on the basis that this will yield better research outcomes. What it's actually done is shield universities from any need to make hard changes. Their reputation is tanking but they just don't seem to care and why should they? They'll get grants from the NIH anyway because they're all as bad as each other, and nobody in politics is talking about a total defunding of the sector yet.

Unfortunately even if the grants were cut off tomorrow they probably would still find it hard to change. It's becoming apparent that if a culture tolerates fraud for decades then eventually the leadership of these institutions are people who got there through fraud. How are universities or journals going to reform when the people who run them know full well they can't crack down on fraud without exposing their own career to audit risk?

Re:Researchers to retract landmark Alzheimer's paper contain... by dbspin on Thursday June 06, 2024 @09:24AM (#40597131)
You've diagnosed the issue then recommended leaches and bleeding.

'Market mechanisms' already exist - no company is precluded from doing research. We can discuss the deficit in research investment that short termist 'market mechanisms' have led to in contemporary corporations, but its absurd to claim that the market can or should replace academic research.

It's pretty clear that in practice the 'publish or perish' academic culture fostered by the financialisation of the university, the rise of the adjunct and the death of tenure have contributed heavily to the falsification of research. In practice encouraging replication, self directed research and significantly more 'pure' 'blue sky' research than governments and universities are inclined to do, would significantly alleviate this problem.

Academia needs far less exposure to 'market mechanisms'. They're perverse incentives for good science.

Re:Researchers to retract landmark Alzheimer's paper contain... by mike_hearn on Thursday June 06, 2024 @01:53PM (#40600360)
To say there's a deficit in research spending pre-supposes there's a correct absolute level of resource allocation that is easily discoverable. But the reason we need markets in the first place is that governments aren't able to discover the right levels of resource allocation on their own. That's why the USSR ended up with lots of steel foundries but no software companies, nor even any competitor to the internet.

If anything research is clearly over-funded right now, especially in some fields like medical research. That's why so many scientists turn to fraud in desperation. There just aren't enough genuine discoveries to go round.

> encouraging replication, self directed research and significantly more 'pure' 'blue sky' research

Replication is the opposite of self directed blue sky research, so how do you suggest it be encouraged whilst simultaneously reducing the power of the money givers even further? BTW, many bogus papers will replicate whilst still being wrong. Replicability is not a synonym for good science.

Really, this is a very common claim that needs to go away. The solution to fraud and incompetence is not to give incompetent fraudsters even more freedom and money.

Re:Researchers to retract landmark Alzheimer's paper contain... by nyssos on Thursday June 06, 2024 @02:30PM (#40600771)
> But the reason we need markets in the first place is that governments aren't able to discover the right levels of resource allocation on their own.

Markets don't discover "the right" (i.e. social welfare maximizing) resource allocation, they discover, under ideal conditions, a pareto-optimal allocation. This is a very weak condition: "Jeff Bezos owns everything" is pareto-optimal. You need redistribution if you want to turn that into a socially optimal one.

In realistic conditions, they don't even do that: market mechanisms will reliably underinvest in things with positive externalities, and the larger the externality the greater the degree of misallocation. The positive externalities of research are enormous compared to the value captured by the researchers.

Re:Researchers to retract landmark Alzheimer's paper contain... by mike_hearn on Thursday June 06, 2024 @02:49PM (#40600991)
No market system anywhere ends up with one person owning everything. That is the standard under non-market systems, though.

> The positive externalities of research

... are only relevant if it's actually research, and not something that looks a lot like research without actually being so.

Re:Researchers to retract landmark Alzheimer's paper contain... by cscurmudgeon on Friday June 07, 2024 @11:40PM (#40615088)
In reality, it is in non-market economies that you have a few owning everything: North Korea (the Kim family), USSR (the party), etc.
Re:Researchers to retract landmark Alzheimer's paper contain... by mistermann on Thursday June 06, 2024 @10:40AM (#40597976)
> Academic science is excluded from market mechanisms by legal fiat...

And a world class propaganda game. Go onto mainstream social media, pick a science fan at random out of the crowd and pick an argument with them about science. The average fan would have you believe that science is just short of perfect.

In a sense it's hard to blame these people, considering what two years of the media machine's full court press of pro-science culture war propaganda during a global pandemic does to a mind of average intelligence.

I mean, I suppose "winning" is important folks, but is losing your soul in the process worth it?

Re:Researchers to retract landmark Alzheimer's paper contain... by pocketsand on Thursday June 06, 2024 @01:45PM (#40600288)
> Academic science is excluded from market mechanisms by legal fiat.

This to me just seems untrue. What is your basis for this claim? There is plenty of research privately funded by corporations, some of which is very influential. Often this work is published by university researchers. Ask any university researcher about the numerous compliance courses we all have to take about funding and conflict of interest.

It is true that the biggest funders (NSF, NIH) are not market-focused, but for good reason. The market does not prioritize the public good. I know first hand -- my son has a rare disease (1 out of 20,000 people). There are many drug companies putting vast resources into drug development in the hopes of a huge payoff. In reality this benefits a small number of people (I remain grateful for how improvements have helped us). I'm grateful our major scientific funding bodies are not swayed entirely by market influences because it would lead to us focusing on a narrow set of scientific problems which would ultimately limit the way it helps the public good.

Im any event, I work in biomedical research. I think your diagnosis (incentives, process) is correct, but the way you discuss the attitudes and motives of researchers is wrong-headed.

You say:

> Their reputation is tanking but they just don't seem to care and why should they? They'll get grants from the NIH anyway because they're all as bad as each other, and nobody in politics is talking about a total defunding of the sector yet.

You're talking about hundreds of thousands of researchers as if they're all psychotic citation fanatics with no care for truth. That is not reality. I think the kind of psychotic, data-manipulating researcher who would put people's health and lives at risk for citations -- or fabricate data sets out of thin air -- are vanishingly small. We can point to a handful of them -- the author of this paper, and the Daniel Ariely's and Francesca Gino's of the world -- but there are tens of thousands of people in every field working on research in good faith, with utmost care. The vast, vast majority never have any scandal, never get caught up in data manipulation, and so on.

No field I know of out-right tolerates fraud (and I follow all the retraction stories fairly closely). I think the closest we get to "toleration" is researchers dealing with scientific problems who more or less say "we're not going to publicly flay you but behind your back we're all going to know what you did and your future is limited when it comes to big grants, prestigious invitations, and so on." People who are credibly accused of fraud become pariahs and often targets of scorn not only within the research community but in the press and wider community.

The most serious issue IMO is not outright but poor norms around scientific practice, leading to p-hacking, harking, and other "forking paths" problems. Calling that type of behavior "fraudulent" is perhaps justifiable under some ways of thinking, but I think the word fraud mischaracterizes what is going on. There are, in fact, many serious efforts to root out this type of behavior and put in transparency rules to open up research to scrutiny, including among funders like the NIH.

Re:Researchers to retract landmark Alzheimer's paper contain... by mike_hearn on Thursday June 06, 2024 @02:09PM (#40600541)
> What is your basis for this claim?

Well you answered your own question: It is true that the biggest funders (NSF, NIH) are not market-focused. A lot of research is funded by taxes. That's an exclusion from market mechanisms. They don't have to convince the actual consumers of the research to buy it, we are all collectively forced to buy it by law.

> No field I know of out-right tolerates fraud

I know quite a few such fields, so we might have a different definition of "tolerate". After all this story contains the following paragraph:

“It’s unfortunate that it has taken 2 years to make the decision to retract,” says Donna Wilcock, an Indiana University neuroscientist and editor of the journal Alzheimer’s & Dementia. “The evidence of manipulation was overwhelming.”

We're talking about a retraction here, which is the weakest response possible. So ... it took two years of "investigation" to do nearly nothing, after other people did all the investigative work for free, and one of the authors continues to be employed with no consequences whatsoever even though his co-author admitted the figures were tampered with. I'd argue this is what institutional tolerance of fraud looks like.

Re:Researchers to retract landmark Alzheimer's paper contain... by DiogenesKynikos on Friday June 07, 2024 @04:44AM (#40606648)
There are no "consumers" who "buy" basic research.

You're talking about fundamental research into basic scientific questions as if it were the same as potato-chip manufacturing.

Re:Researchers to retract landmark Alzheimer's paper contain... by mike_hearn on Friday June 07, 2024 @07:27AM (#40607544)
The "consumer" who "buys" research in a commercial setting is usually the executive who is funding the department. In that context stuff like P-hacking, HARKing etc doesn't happen much because at some point your bosses boss is going to read your internal paper and notice that your claimed discovery has nothing to do with what you were originally asked to investigate. In academia that doesn't matter, it still counts as a discovery because nobody is really checking your pre-registrations. In corporate research it'll either be checked by the people paying your salary, or at a larger scale, it'll be checked by a regulator who is forcing you to pre-register your clinical trials.
Re:Researchers to retract landmark Alzheimer's paper contain... by DiogenesKynikos on Friday June 07, 2024 @08:12AM (#40607909)
There's no "consumer" who "buys" research into whether protons decay. That's basic research that will only occur if funded by national agencies that are not motivated by return on investment.

As for commercial research, similar problems of fraud exist as in academic research. Instead of prestige, the motivations are things like bonuses and promotions.

Academics actually care a great deal about fraud, funding agencies hate fraud and punish it, journals hate fraud - everyone dislikes it. Competing labs have every incentive to catch fraud conducted by their rivals. The idea that academia is rife with fraud and that nobody cares is just not true.

There will always be a certain level of fraud not just in research, but in every economic sector, every intellectual pursuit, and every sport, commercial or not. There's no system that will perfectly eliminate it, but because of its empiricism and openness, science is fairly good at correcting itself over time.

Re:Researchers to retract landmark Alzheimer's paper contain... by mike_hearn on Friday June 07, 2024 @10:58AM (#40609344)
Physics gets large amounts of commercial investment. Quantum computers have been invested in heavily by the private sector for years. The defense world invests in laser research, etc. Plenty of examples out there. You can always find a topic you personally feel is super important even though it has no practical applications today, but such arguments are unfalsifiable. I can just as easily argue [more] proton decay research doesn't matter [yet] and you can't prove I'm wrong, so it's not worth going there.

The same problems exist but not on the same scale. If your employer discovers you committed fraud to get a promotion you will certainly be fired and quite probably be taken to court by their legal department. If the fraud is at the level of the company they risk destruction and imprisonment by the government. It's not like in academia where they'll sit on it for years and then, maybe, request a little notice to be put on the paper's web page - all without the government even noticing let alone caring. The huge difference in consequences yields different risk/reward ratios and that's reflected in how often these problems are found.

> Academics actually care a great deal about fraud, funding agencies hate fraud and punish it, journals hate fraud - everyone dislikes it.

Do they? How is the co-author of this paper still employed if funding agencies punish it? Where are the university funded research-police departments? Why do we keep hearing cases like this Alzheimer's one and why are there never any announcements by Vice Chancellors about doubling investment into fraud investigations as a consequence? Why is a research audit not something that these fraudsters fear? How is it the case that publishers discover after the fact that dozens of their journals have been completely compromised by paper mills, instead of it being discovered via some more active process before publication occurs?

> science is fairly good at correcting itself over time

Absolutely not. If science was good at self correcting it wouldn't take nearly two decades for someone to notice that a widely cited paper was forged, and the people who notice these things wouldn't need to be anonymous. But they do. Look at the Gino case. She launched a massively well funded lawsuit against the people claiming she engaged in fraud. That's the exact opposite of self correction.

Re:Researchers to retract landmark Alzheimer's paper contain... by DiogenesKynikos on Friday June 07, 2024 @02:07PM (#40611233)
> Physics gets large amounts of commercial investment.

Almost all funding for basic research, including for physics, comes from governments. There are a few niche areas of basic research, like quantum computing, that also attract commercial investment, and there is plenty of applied research, but governments are almost the only game in town for basic research.

I think fraud is actually a much larger problem in commercial research, because the incentives to cheat are much stronger. There's real money at play. Theranos was a massive fraud. There's plenty of fraud and misconduct in the pharma industry. And when it comes to academia, the fields that have the most commercial potential (like biomedical research) have the worst problems with fraud.

> How is the co-author of this paper still employed if funding agencies punish it?

Is the co-author guilty of fraud?

> Where are the university funded research-police departments?

It's the funding agencies, the journals and other academics that are most involved in finding fraud.

> Why do we keep hearing cases like this Alzheimer's one

Because there's a huge volume of research, and some small percentage of it will be fraudulent.

> why are there never any announcements by Vice Chancellors about doubling investment into fraud investigations as a consequence?

That might be a bad allocation of resources. If fraud is a rare phenomenon and isn't severely impacting a field, then the current level of investigations might be sufficient. Add to that the fact that the way most of these frauds are uncovered is by competing researchers.

Re:Researchers to retract landmark Alzheimer's paper contain... by Log_out_ on Saturday June 08, 2024 @12:43AM (#40615342)
Maybe it should become best practice to publish honeypots. Anyone who claims to reproduce these papers or cites thsm gets autolisted for fraud.
Re:Researchers to retract landmark Alzheimer's paper contain... by kylebenzle on Thursday June 06, 2024 @12:18PM (#40599217)
A lot of science is fake, if not most of it. I learned the hard way in academia that it really seems the majority of PhD level researchers are there because they are willing to stretch the truth to "tell a good story".
Re:Researchers to retract landmark Alzheimer's paper contain... by eigenschwarz on Thursday June 06, 2024 @12:24PM (#40599295)
Talk about a sweeping conclusion based on n=1! Very unscientific ;)
Re:Researchers to retract landmark Alzheimer's paper contain... by Fatnino on Thursday June 06, 2024 @12:25PM (#40599313)
Sounds ready to publish