News for hackers. Stuff that matters.
Re:A Calif. teen trusted ChatGPT for drug advice. He died fr... by chenyusu on Monday January 05, 2026 @12:29PM (#46501822)
We should develop some methods to detect the nonsense in the coherent stories that LLMs are telling
Re:A Calif. teen trusted ChatGPT for drug advice. He died fr... by uyzstvqs on Monday January 05, 2026 @01:27PM (#46502627)
So "drug advice" refers to drug abuse, not medicine. ChatGPT gave several bad replies, but this was in between constant warnings about the dangers, which were ignored. The guy even told ChatGPT to "[not] get into the medical stuff about the dangers".

Why did ChatGPT give the bad replies? It appears that it fell for the false "harm reduction" narrative. This should obviously be improved.

Saying that he "trusted ChatGPT for drug advice" or attributing the overdose to ChatGPT is straight up misleading. This is ragebait, and clearly not from a reliable source.