News for hackers. Stuff that matters.
Re:OpenAI says over a million people talk to ChatGPT about s... by atleastoptimal on Tuesday October 28, 2025 @06:36AM (#45731161)
OpenAI tried to get rid of the excessively sycophantic model (4o) but there was a massive backlash. They eventually relented and kept it as a model offering in ChatGPT.

OpenAI certainly has made mistakes with its rollouts in the past, but it is effectively impossible to keep everyone with psychological issues away from a free online web app.

>ChatGPT should be nowhere near anyone dealing with psychological issues.

Should every ledge with a >10ft drop have a suicide net? How would you imagine this would be enforced, requiring everyone who uses ChatGPT to agree to an "I am mentally stable" provisio?

Re:OpenAI says over a million people talk to ChatGPT about s... by fireflash38 on Tuesday October 28, 2025 @07:12AM (#45731373)
Do you think that it's free and available to anyone means it doesn't have any responsibility to users? Or have any responsibility for how it's used, or what it says?
Re:OpenAI says over a million people talk to ChatGPT about s... by atleastoptimal on Tuesday October 28, 2025 @02:45PM (#45737043)
It’s an open problem in AI development to make sure LLM’s never say the “wrong” thing. No matter what, when dealing with a non-deterministic system, one can’t anticipate or oversee the moral shape of all its outputs. There are a lot of things however that you can’t get ChatGPT to say, and they often ban users after successive violations, so it isn’t true that they are fully abdicating responsibility for the use and outputs of their models in realms where the harm is tractable.