News for hackers. Stuff that matters.
Re:ChatGPT Pro by stanford_labrat on Friday December 06, 2024 @10:54AM (#42340886)
I recently (in the last month) asked ChatGPT to cite its sources for some scientific data. It gave me completely made up, entirely fabricated citations for academic papers that did not exist.
Re:ChatGPT Pro by alphan0n on Friday December 06, 2024 @12:02PM (#42341596)
Share a link to the conversation.
Re:ChatGPT Pro by madaxe_again on Friday December 06, 2024 @04:24PM (#42344617)
What a bizarre thing to request. Do you go around accusing everyone of lying?
Re:ChatGPT Pro by alphan0n on Sunday December 08, 2024 @01:26PM (#42358986)
So sorry to offend your delicate sensibilities by calling out a blatant lie from someone completely unrelated to yourself. Pretty bizarre behavior in itself to do so.
Re:ChatGPT Pro by dbbk on Monday December 09, 2024 @10:53AM (#42367340)
Except there are news stories of this happening to people
Re:ChatGPT Pro by alphan0n on Monday December 09, 2024 @01:01PM (#42368592)
I suspect there being a shred of plausibility is why there’s so many people lying about it for attention.

It’s as simple as copying and pasting a link to prove it. If it is actually happening, it would benefit us all to know the facts surrounding it.

Re:ChatGPT Pro by stanford_labrat on Monday December 09, 2024 @06:47PM (#42371916)
sure, here's a link of a conversation from today 12/9/24 which has multiple incorrect: references, links, papers, journal titles, DOIs, and authors.

https://chatgpt.com/share/6757804f-3a6c-800b-b48c-ffbf144d73...

as just another example, chatgpt said in the Okita paper that they switched media on day 3, when if you read the paper they switched the media on day 8. so not only did it fail to generate the correct reference, it also failed to accurately interpret the contents of a specific paper.

Re:ChatGPT Pro by barrkel on Saturday December 07, 2024 @06:49PM (#42353803)
Here you go: https://chatgpt.com/share/6754df02-95a8-8002-bc8b-59da11d276...

ChatGPT regularly searches and links to sources.

Re:ChatGPT Pro by alphan0n on Sunday December 08, 2024 @01:23PM (#42358953)
I was asking for a link to the conversation from the person I was replying to.
Re:ChatGPT Pro by yuvalr1 on Friday December 06, 2024 @11:10AM (#42341047)
Did the model search the internet?

The behavior you're describing sounds like an older model behavior. When I ask for links to references these days, it searches the internet the gives me links to real papers that are often actually relevant and helpful.

Re:ChatGPT Pro by stanford_labrat on Friday December 06, 2024 @01:33PM (#42342642)
I don’t recall that it ever mentioned if it did or not. I don’t have the search on hand but from my browser history I did the prompt engineering on 11/18 (which perhaps there is a new model since then?).

I actually repeated the prompt just now and it actually gave me the correct, opposite response. For those curious, I asked ChatGPT what turned on a gene, and it said Protein X turns on Gene Y as per -fake citation-. Asking today if Protein X turns on Gene Y ChatGPT said there is no evidence, and showed 2 real citations of factors that may turn on Gene Y.

Pretty impressed!