News for hackers. Stuff that matters.
Re:AI therapy bots fuel delusions and give dangerous advice,... by mlinhares on Wednesday July 16, 2025 @08:47PM (#44588522)
You'll never get the attention of your priest at the same level as a chatbot. Not even close, this is a whole new universe.
Re:AI therapy bots fuel delusions and give dangerous advice,... by mathiaspoint on Wednesday July 16, 2025 @08:50PM (#44588538)
I'd argue chatbots give zero actual attention since they're not human (other than in the irrelevant technical sense.) Saying they can is a bit like saying a character in a book or an imaginary friend can.

It will probably take a few years for the general public to fully appreciate what that means.

Re:AI therapy bots fuel delusions and give dangerous advice,... by Terr_ on Wednesday July 16, 2025 @09:03PM (#44588639)
> attention

Then perhaps "responsiveness", even if misinterpreted as attention. In a similar way to the responsiveness of a casino slot-machine.

Re:AI therapy bots fuel delusions and give dangerous advice,... by bluefirebrand on Wednesday July 16, 2025 @10:39PM (#44589174)
> It will probably take a few years for the general public to fully appreciate what that means

I think you are very optimistic if you think the general public will ever fully understand what it means

As these get more sophisticated, the general public will be less and less capable of navigating these new tools in a healthy and balanced fashion

Re:AI therapy bots fuel delusions and give dangerous advice,... by mlinhares on Wednesday July 16, 2025 @08:58PM (#44588601)
Doesn't matter what we think, this is how people are perceiving them :(
Re:AI therapy bots fuel delusions and give dangerous advice,... by djtango on Thursday July 17, 2025 @01:31AM (#44589998)
Assuming we are comparing ChatGPT to an in person therapist, there's a whole universe of extra signals ChatGPT is not privy to. Tone of voice, cadence of speech, time to think, reformulated responses, body language.

These are all CRUCIAL data points that trained professionals also take cues from. An AI can also be trained on these but I don't think we're close to that yet AFAIK as an outsider.

People in need of therapy could (and probably are) unreliable narrators and a therapist's job is to manage long range context and specialist training to manage that.

Re:AI therapy bots fuel delusions and give dangerous advice,... by Bluestein on Thursday July 17, 2025 @01:48AM (#44590093)
> don't think we're close to that yet AFAIK as an outsider.

I was gonna say: Wait until LLMs start vectorizing to sentiment, inflection and other "non content" information, and matching that to labeled points, somehow ...

... if they ain't already.-

Re:AI therapy bots fuel delusions and give dangerous advice,... by djtango on Thursday July 17, 2025 @03:53AM (#44590806)
I am curious how this will work in the wild. I believe the capability will exist but with things like body language and facial expressions, it can be really subtle and even if it's possible, I think that run of the mill consumer hardware will not be high fidelity enough and will bring in too much noise.

This reminds me of the story of how McDonald's abandoned automated drive thru voice input because in the wild there was too many uncontrolled variables but speech recognition has been a "solved problem" for a long time now...

Re:AI therapy bots fuel delusions and give dangerous advice,... by interestica on Thursday July 17, 2025 @02:17AM (#44590244)
ConfessionGPT?