News for hackers. Stuff that matters.
Re:AI tools are spotting errors in research papers: inside a... by wizzwizz4 on Saturday March 08, 2025 @10:17AM (#43300876)
Is there advantage over just reviewing papers with a critical eye?
Re:AI tools are spotting errors in research papers: inside a... by Zigurd on Saturday March 08, 2025 @10:31AM (#43300960)
There's probably 10 X more problematic academic publications, than currently get flagged. Automating the search for the likeliest candidates is going to be very helpful by focusing the "critical eye" where it can make the biggest difference.
Re:AI tools are spotting errors in research papers: inside a... by epidemiology on Saturday March 08, 2025 @10:37AM (#43300997)
The largest problems with most publications (in epi and in my opinion at least) is study design. Unfortunately, faulty study design or things like data cleaning is qualitative, nuanced, and difficult to catch with AI unless it has access to the source data.
Re:AI tools are spotting errors in research papers: inside a... by estarkio on Saturday March 08, 2025 @10:21AM (#43300895)
I think some people will find an advantage in flagging untold numbers of research papers as frivolous or fraudulent with minimal effort, while putting the burden of re-proving the work on everyone else.

In other words, I fear this is a leap in Gish Gallop technology.

Re:AI tools are spotting errors in research papers: inside a... by AlienRobot on Saturday March 08, 2025 @10:32AM (#43300965)
Hopefully, one would use this to try to find errors in a massive number of papers, and then go through the effort of reviewing these papers themselves before bringing up the issue. It makes no sense to put effort unto others just because the AI said so.
Re:AI tools are spotting errors in research papers: inside a... by jeffbee on Saturday March 08, 2025 @10:19AM (#43300890)
If reviewer effort is limited and the model has at least a bias in the right direction.
Re:AI tools are spotting errors in research papers: inside a... by wizzwizz4 on Saturday March 08, 2025 @10:30AM (#43300954)
So I just need to make sure my fraud goes under the radar of these AI tools, and then the limited reviewer effort will be spent elsewhere.