News for hackers. Stuff that matters.

A comment on What OpenAI Did When ChatGPT Users Lost Touch with Reality: DAU Optimization. Parent comment

Re:What OpenAI Did When ChatGPT Users Lost Touch with Realit... by roenxi on Tuesday November 25, 2025 @06:44AM (#46044889)
There are a lot of edge cases where suicide is rational. The experience of watching an 80 year old die over the course of a month or few can be quite harrowing from the reports I've had from people who've witnessed it; most of whom talk like they'd rather die in some other way. It's a scary thought, but we all die and there isn't any reason it has to be involuntary all the way to the bitter end.

It is quite difficult to say what moral framework an AI should be given. Morals are one of those big unsolved problems. Even basic ideas like maybe optimising for the general good if there are no major conflicting interests are hard to come to a consensus on. The public dialog is a crazy place.

[ Parent | on HN ]
Re:What OpenAI Did When ChatGPT Users Lost Touch with Realit... by cowsandmilk on Tuesday November 25, 2025 @08:06AM (#46045417)
The stories coming out are about convincing high school boys with impressionable brains into committing suicide, not about having intellectual conversations with 80 year olds about whether suicide to avoid gradual mental and physical decline makes sense.
[ Parent | on HN ]
Re:What OpenAI Did When ChatGPT Users Lost Touch with Realit... by roenxi on Tuesday November 25, 2025 @03:58PM (#46050700)
Yeah, that is why I wrote the comment. The stories are about one case where the model behaviour doesn't make sense - but there are other cases where the same behaviour is correct.

As jb_rad said in the thread root, hyper-focusing on the risk will lead people to overreact. DanielVZ says we should hyper focus, maybe even overreact to the point of banning AI because it can persuade people to suicide. However the best view to do is acknowledge the nuance where sometimes suicide is actually the best decision and it is just a matter of getting as close as possible to the right line.

[ Parent | on HN ]