News for hackers. Stuff that matters.
Re:Data detectives spotted fake numbers in a widely cited paper by feikname on Monday September 06, 2021 @06:28AM (#28432281)
It always suprises me how people don't do minimum effort for hiding this stuff.

And no one notices. (or don't care about the obviously suspicious aspect)

Do scientists actually read what they cite?

Re:Data detectives spotted fake numbers in a widely cited paper by uuidgen on Monday September 06, 2021 @08:23AM (#28432984)
Did YOU even check what you cite?

The AUTHORS of the original paper got a dataset from a company. They didn't assume the fraud from the start and published the paper based on it.

Later, when they tried to analyze the issue more in-depth, they couldn't replicate the results. THE ORIGINAL AUTHORS PUBLISHED a paper about a failure to replicate. It was just then that someone looked at the original data and found that it was faked.

Re:Data detectives spotted fake numbers in a widely cited paper by smitty1e on Monday September 06, 2021 @08:37AM (#28433070)
Divison of Labour[1] is powerful. The need is to incentivise feedback loops to QA the data on the front end.

The fear of reputational implosion is apparently insufficient.

[1] https://en.m.wikipedia.org/wiki/Division_of_labour

Re:Data detectives spotted fake numbers in a widely cited paper by feikname on Monday September 06, 2021 @03:47PM (#28437262)
> Did YOU even check what you cite?

I did completely read what was available to me without having an account.

> The AUTHORS of the original paper got a dataset from a company. They didn't assume the fraud from the start and published the paper based on it.

My comment is not about who the culprit is or isn't. Indeed, I don't mention anything about it.

Rather, it's about how, as the title says, a WIDELY cited paper has fabricated data following rather (IMO) obvious red flag patterns and none of the people -who cited the paper- raised issues about that.

Thus, I questioned whether scientists read or not the papers they cite in the parent post. The question is not a judgment, I'm just truly curious since I'm not part of the formal academia, just an undergraduate.

Re:Data detectives spotted fake numbers in a widely cited paper by bobcostas55 on Monday September 06, 2021 @11:07AM (#28434385)
It's seems highly likely that Ariely did it, not the company.
Re:Data detectives spotted fake numbers in a widely cited paper by fighterpilot on Monday September 06, 2021 @02:39PM (#28436647)
Why do you say that?
Re:Data detectives spotted fake numbers in a widely cited paper by bobcostas55 on Tuesday September 07, 2021 @09:50AM (#28444823)
He created the excel file. If he wanted to clear his name he could publish the original data as it was sent from the company, but he hasn't done so. And the company obviously has no incentive to falsify the data.
Re:Data detectives spotted fake numbers in a widely cited paper by smitop on Monday September 06, 2021 @07:54AM (#28432793)
If they did a good job hiding it then you wouldn't know about it. For every case like this where they made a obvious mistake, there are cases where they didn't, and nobody noticed. But you only tend to hear about the ones with obvious mistakes.
Re:Data detectives spotted fake numbers in a widely cited paper by ackbar03 on Monday September 06, 2021 @07:58AM (#28432818)
> Do scientists actually read what they cite?

No. What are you kidding me. There's like typically over 50 papers referenced in a typical publication, no way I have the time to read all of them carefully

Re:Data detectives spotted fake numbers in a widely cited paper by matheusmoreira on Monday September 06, 2021 @08:01AM (#28432843)
> Do scientists actually read what they cite?

Yes, but few actually scrutinize the methodology of the studies. Statistics is really hard. It's easier to assume peer reviewers would have rejected the paper if it was bad.

Re:Data detectives spotted fake numbers in a widely cited paper by samhw on Monday September 06, 2021 @12:05PM (#28435075)
Benford's law (https://en.wikipedia.org/wiki/Benford%27s_law) is a pretty well-known test for fraudulent numbers. Of course, it's not infallible and (depending on the nature of the fake) it may be possible to tailor the numbers to 'pass' it, but it's a good heuristic. I'd be curious to know whether it would have detected this - and, if so, whether it was indeed used.
Re:Data detectives spotted fake numbers in a widely cited paper by tasogare on Monday September 06, 2021 @07:55AM (#28432796)
> Do scientists actually read what they cite?

I depends on ones probity, but yes the phenomenon is widespread. There are numerous reasons to cite a paper and just read it superficially: padding the references list, pleasing a reviewer by adding a paper he recommended, citing friends, etc. In my own lab they frequently cite a certain theory which if you actually read about it has nothing to do with what they are doing.

Re:Data detectives spotted fake numbers in a widely cited paper by vidarh on Monday September 06, 2021 @10:24AM (#28433948)
The problem is often that reading it is insufficient. Unless you try to replicate, it may well look plausible, and often missing data or details creates barriers that makes you need to want to replicate really badly to put in the effort.