News for hackers. Stuff that matters.
Re:AI therapy bots fuel delusions and give dangerous advice,... by ClumsyPilot on Thursday July 17, 2025 @01:39AM (#44590041)
> A well-trained LLM that lacks any malevolent data

This is self-contradictory. An LLM must have malevolent data to identify malevolent intentions. A naive LLM will be useless. Might as well get psychotherapy from a child.

Once LLM has malevolent data, it may produce malevolent output. LLM does not inherently understand what is malevolence. It basically behaves like a psychopath.

You are trying to get a psychopath-like technology to do psychotherapy.

It’s like putting gambling addicts in charge of the world financial system, oh wait…

Re:AI therapy bots fuel delusions and give dangerous advice,... by Dylan16807 on Thursday July 17, 2025 @02:40AM (#44590397)
I ask this with all sincerity, why is it important to be able to detect malevolent intentions from the person you're giving therapy to? (In this scenario, you cannot be hurt in any way.)

In particular, if they're being malevolent toward the therapy sessions I don't expect the therapy to succeed regardless of whether you detect it.