News for hackers. Stuff that matters.
Re:AI beats human sleuth at finding problematic images in re... by sideshowb on Wednesday October 04, 2023 @07:06PM (#37772965)
The article seems to discuss manipulation (a valid concern) but the research focuses on duplication. I'm not entirely clear what the link between the two is?
Re:AI beats human sleuth at finding problematic images in re... by xnx on Wednesday October 04, 2023 @07:09PM (#37772978)
Duplicated images are often a substitute for real data. https://www.newyorker.com/science/elements/how-a-sharp-eyed-...
Re:AI beats human sleuth at finding problematic images in re... by explaininjs on Wednesday October 04, 2023 @07:17PM (#37773020)
Yikes. She contacted the journal to report this clear fraud they were perpetuating and received no response for 6 months. Yet people equate “peer reviewed” and “absolute fact”.
Re:AI beats human sleuth at finding problematic images in re... by Waterluvian on Wednesday October 04, 2023 @08:37PM (#37773560)
If you want to hear back from any organization, you’ve got to write it on lawyer letterhead.
Re:AI beats human sleuth at finding problematic images in re... by staunton on Wednesday October 04, 2023 @09:04PM (#37773750)
Which indeed doesn't work for journals because publishing wrong research isn't (and shouldn't be) illegal...
Re:AI beats human sleuth at finding problematic images in re... by Waterluvian on Thursday October 05, 2023 @10:30AM (#37779076)
I just mean, it’s so easy to ignore inquiries and I’ve found that if you ever get ignored and need to be heard, a lawyer’s letterhead attracts attention.

I agree with the legal issue you put forth.

Re:AI beats human sleuth at finding problematic images in re... by eru on Thursday October 05, 2023 @10:37PM (#37786622)
Yes, but the social engineering aspect of that trick might still work.
Re:AI beats human sleuth at finding problematic images in re... by HideousKojima on Wednesday October 04, 2023 @09:03PM (#37773743)
Peer review means "has no blatantly obvious methodological issues" at best, and not even that a decent amount of the time. A lot of people take it to mean that the paper's results/conclusions are accurate.
Re:AI beats human sleuth at finding problematic images in re... by eru on Thursday October 05, 2023 @10:37PM (#37786623)
Peer review standards also differ between fields and journals.
Re:AI beats human sleuth at finding problematic images in re... by courseofaction on Wednesday October 04, 2023 @09:42PM (#37774002)
I think this demonstrates a hypothesis: The institution is failing, the technology which exploits the failure is close to irrelevant.
Re:AI beats human sleuth at finding problematic images in re... by wolverine876 on Thursday October 05, 2023 @12:48AM (#37774995)
> I think this demonstrates a hypothesis: The institution is failing

This claim needs to be more specific to be meaningful: How is the 'institution' defined? What evidence do we have that it's performing worse than before, or not functioning (producing valuable scientific knowledge)?

Re:AI beats human sleuth at finding problematic images in re... by maxbond on Thursday October 05, 2023 @01:22AM (#37775156)
I think when lay people say "peer reviewed research" they mean it as a metanym for "the scientific consensus as established by empirical research and vigorous debate," which isn't absolute fact to be sure, but is about as sturdy a foundation as you can hope for. I think I know more about peer review and retractions than most people - and I know next to nothing.
Re:AI beats human sleuth at finding problematic images in re... by hirundo on Wednesday October 04, 2023 @07:41PM (#37773195)
> She found that it contained text plagiarized from eighteen uncredited sources, which she categorized using color-coded highlighting.

That kind of plagiarism is a sign that AI wasn't used, since once tokenized the same concepts are seldom rephrased verbatim. The same problem applies to problematic images. Regenerated-with-alternations is harder to detect than Photoshop. Things will get interesting when you can cheaply generate middle-tier quality scientific papers with a short AI prompt.