News for hackers. Stuff that matters.
Re:AI tools are spotting errors in research papers: inside a... by cycomanic on Saturday March 08, 2025 @01:45PM (#43302406)
Where is that evidence? The paper you cite suggests that p hacking is done in experimental accounting studies but not archival.

Generally speaking, evidence suggests that fraud rates are low ( lower than in most other human endeavours). This study cites 2% [1]. This is similar to numbers that Elizabeth Bik reports. For comparison self reported doping rates were between 6 and 9% here [2]

[1] https://pmc.ncbi.nlm.nih.gov/articles/PMC5723807/ [2] https://pmc.ncbi.nlm.nih.gov/articles/PMC11102888/

Re:AI tools are spotting errors in research papers: inside a... by mike_hearn on Saturday March 08, 2025 @02:57PM (#43302983)
The 2% figure isn't a study of the fraud rate, it's just a survey asking academics if they've committed fraud themselves. Ask them to estimate how many other academics commit fraud and they say more like 10%-15%.
Re:AI tools are spotting errors in research papers: inside a... by signatoremo on Saturday March 08, 2025 @03:28PM (#43303243)
So which figure is more accurate in your opinion?
Re:AI tools are spotting errors in research papers: inside a... by mike_hearn on Saturday March 08, 2025 @03:35PM (#43303293)
See my other reply to Matthew. It's very dependent on how you define fraud, which field you look at, which country you look at, and a few other things.

Depending on what you choose for those variables it can range from a few percent up to 100%.

Re:AI tools are spotting errors in research papers: inside a... by cycomanic on Saturday March 08, 2025 @10:40PM (#43305972)
Those 15% is actually if they know someone who has committed academic misconduct not fraud (although there is an overlap it's not the same), and it is across all levels (I.e. from PI to PhD student). So this will very likely overestimate fraud, as we would be double counting (I.e. Multiple reporters will know the same person). Imporantly the paper also says if people reported the misconduct it had consequences in the majority of cases.

And just again for comparison >30% of elite athlete say that they know someone who doped.