News for hackers. Stuff that matters.
Re:With AI chatbots, Big Tech is moving fast and breaking pe... by MisterTea on Monday August 25, 2025 @03:29PM (#45017927)
My friend admitted to having political and religious arguments with chatgpt. They have mental issues which contributed.
Re:With AI chatbots, Big Tech is moving fast and breaking pe... by beacon473 on Monday August 25, 2025 @03:43PM (#45018104)
What's wrong with using an LLM to learn about politics and religion?

I've found Claude to be an excellent tool to facilitate introspective psychoanalysis. Unlike most human therapists I've worked with, Claude will call me on my shit and won't be talked into agreeing with my neurotic fantasies (if prompted correctly).

Re:With AI chatbots, Big Tech is moving fast and breaking pe... by 42lux on Monday August 25, 2025 @04:05PM (#45018341)
No you are gaslighting yourself without recognizing it. That's what we are talking about.
Re:With AI chatbots, Big Tech is moving fast and breaking pe... by iinnPP on Monday August 25, 2025 @04:15PM (#45018451)
It's impossible to gaslight yourself as it requires intention.
Re:With AI chatbots, Big Tech is moving fast and breaking pe... by 42lux on Monday August 25, 2025 @04:25PM (#45018562)
He wants to be called a good boy, so the LLM calls him a good boy. Since the LLM is a machine that does what you want, he's essentially doing it to himself. It might not be a conscious choice, but there's still intention behind it. Kein Herr im eigenen Haus. (No master in one's own house.) - Sigmund Freud. He was wrong about a lot of stuff but this is one thing that still stands.

It's called unconscious intention, and here's a pretty interesting paper that'll bring you up to speed: https://irl.umsl.edu/cgi/viewcontent.cgi?article=1206&contex...

Re:With AI chatbots, Big Tech is moving fast and breaking pe... by iinnPP on Monday August 25, 2025 @05:08PM (#45019031)
I'm sure you can be unconsciously intent on things, but gaslighting is a unique concept. Here's the definition I am relying on: manipulate (someone) using psychological methods into questioning their own sanity or powers of reasoning.

In your provided example, the user is obviously not trying to manipulate someone into questioning their sanity, nor power of reasoning. Quite the opposite. Lying to themselves (your example) for sure.

Re:With AI chatbots, Big Tech is moving fast and breaking pe... by 42lux on Monday August 25, 2025 @05:23PM (#45019201)
gaslighting is the act of invalidating one’s own, true experience and yes you can do it yourself.

https://philpapers.org/rec/MCGAIG

https://www.psychologytoday.com/us/blog/emotional-sobriety/2...

Re:With AI chatbots, Big Tech is moving fast and breaking pe... by Night_Thastus on Monday August 25, 2025 @04:26PM (#45018579)
Because unlike a human who can identify that some lines of reasoning are flawed or unhealthy, an LLM will very happily be a self-contained echo chamber that will write whatever you want with some nudging.

It can drive people further and further into their own personal delusions or mental health problems.

You may think it's being critical of you, but it's not. It's ultimately interacting you on your terms, saying what you want to hear when you want to hear it. That's not how therapy works.

Re:With AI chatbots, Big Tech is moving fast and breaking pe... by beacon473 on Thursday August 28, 2025 @07:29AM (#45050874)
> You may think it's being critical of you, but it's not. It's ultimately interacting you on your terms, saying what you want to hear when you want to hear it.

That's been my experience with human therapists. When I tell Claude to stop being sycophantic, it complies. When I tell a human to stop being sycophantic, they get defensive.

I agree that an ideal human therapists would be better than Claude, but most that I've worked with are far from ideal. Most are not very bright, easily manipulated, and quick to defensiveness when questioned. And Claude won't try to get me to take random meds with the only justification for the specific medication being 'got to start somewhere'.

Re:With AI chatbots, Big Tech is moving fast and breaking pe... by ramesh31 on Monday August 25, 2025 @04:14PM (#45018437)
>My friend admitted to having political and religious arguments with chatgpt. They have mental issues which contributed.

To be fair these are probably the same people who would have been having these conversations with squirrels in the park otherwise.

Re:With AI chatbots, Big Tech is moving fast and breaking pe... by gjsman-1000 on Monday August 25, 2025 @04:16PM (#45018464)
We don't actually know that. It's a nice stereotype, but there's no source to prove these people would've done it anyway.