News for hackers. Stuff that matters.
Re:Google Scholar search: "certainly, here is" -chatgpt -llm by baobabKoodaa on Sunday March 17, 2024 @08:02AM (#39733861)
There are only a few search results on this list which appear to be ChatGPT generated. If you filter the list by "after 2020", you will see the number of results drop from 657 to 71 (ChatGPT did not exist in 1962, so it could not have possibly written scholarly articles in 1962).

Here is an excerpt from one of the results after constraining the search to "after 2020":

Hundreds of young men are crowding them, to prepare for the army and navy, to represent their country in some future war. Certainly here is ample preparation for the patriot of war. But is our country offering an equal opportunity to the one who would serve herin times of peace?

This is similar to the case where a journalist typed "15 year old" on Pornhub search, didn't understand how search works, and didn't look at the results.

Re:Google Scholar search: "certainly, here is" -chatgpt -llm by gillesjacobs on Sunday March 17, 2024 @08:24AM (#39733980)
Yes exactly the whole claim is fundamentally flawed.

Better queries would include proper timeframing and all LLM-preference-tuning phrases from https://github.com/AlpinDale/gptslop

But even then, I don't think this is the gotcha OP thinks it is: LLM generation and summarizing is a legit tool in the paper writing process, especially for conclusions.

In my academic experience, the paper introduction and conclusion is often written last-minute, close to the submission deadline. While a good intro and conclusion are important for the reader, very little time is made available for it since researchers spend maximal time on expanding material findings and experiments. No wonder that assistive writing tools are used to speed things up. As long as proper post-editing and proof-reading is applied.

Re:Google Scholar search: "certainly, here is" -chatgpt -llm by semanticist on Sunday March 17, 2024 @08:46AM (#39734121)
> As long as proper post-editing and proof-reading is applied for course.

The whole point of the original article is that people aren't doing even that.

Plus in an academic context, it's important to acknowledge when parts of the paper are not your own work, especially in cases where the generated summary may not accurately reflect the actual paper. Saying that ChatGPT has been used to generate summaries would allow people to judge if the summary alone can be trusted to represent the content of the paper.

Re:Google Scholar search: "certainly, here is" -chatgpt -llm by aredox on Sunday March 17, 2024 @08:22AM (#39733965)
Exactly. A correct analysis would be to determine the baseline pre-chatGPT, examine if there is a trend (some language "clichés" evolve with time) and then check if there is a clear shift post-ChatGPT.
Re:Google Scholar search: "certainly, here is" -chatgpt -llm by Jabbles on Sunday March 17, 2024 @08:38AM (#39734070)
The link in the post is https://scholar.google.fr/scholar?hl=fr&as_sdt=0%2C5&as_ylo=...

Which already filters after 2023.

Re:Google Scholar search: "certainly, here is" -chatgpt -llm by baobabKoodaa on Sunday March 17, 2024 @08:57AM (#39734184)
Sorry, I made a mistake when I tried to switch from French Scholar to English