News for hackers. Stuff that matters.
Re:Signs of undeclared ChatGPT use in papers mounting by breakwaterlabs on Friday October 06, 2023 @01:35PM (#37793631)
The article also gives the example of the phrase "as an AI language model, I..." being found in published papers.

The fact that this slipped by the paper's author, their editor, *and the journal review* is not benign.

I agree with the author here: is no one reading these papers before putting their names behind them? Is the entire journal system entirely fraudulent?

Re:Signs of undeclared ChatGPT use in papers mounting by matthewdgreen on Friday October 06, 2023 @01:36PM (#37793648)
See point (3) in my post above.
Re:Signs of undeclared ChatGPT use in papers mounting by StableAlkyne on Friday October 06, 2023 @02:05PM (#37794019)
Peer review is a mixed bag. It's the best system we've come up with, but still can be hit or miss.

Depends on how much the journal is willing to push the authors (predatory journals don't give a heck, prestigious journals usually care more because they've got a rep to uphold). Reviewers can be anyone from an expert in the field, a competitor who gives you a hard time (usually they're not actively malicious though), to some random prof doing it because the editor couldn't find anyone else, or even a grad student in the lab of a prof (it's a common training exercise).

I've had articles with anywhere from 1-3 reviewers, there is no standard beyond "the editor is a basic crackpottery filter, there is an external reviewer, and a copy editor makes it fit for viewing"

Re:Signs of undeclared ChatGPT use in papers mounting by breakwaterlabs on Tuesday October 10, 2023 @11:46AM (#37833643)
If the system is not catching "I am a language model", I have zero confidence in its ability to detect crackpottery, much less more insidious things like P-hacking.