News for hackers. Stuff that matters.
Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by shimman on Saturday March 28, 2026 @12:31PM (#47556090)
You can't be careful at all doing this, this is like smoking a cigarette in a dynamite factory.

Using LLMs for therapy is so deeply dystopian and disgusting, people need human empathy for therapy. LLMs do not emit empathy.

Complete disaster waiting to happen for that individual.

Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by nuancebydefault on Saturday March 28, 2026 @02:19PM (#47557034)
My experience is that it tries to look at your situation in an objective way, and tries to help you to analyse your thoughts and actions. It comes across as very empathetic though, so there can lie a danger if you are easily persuaded into seeing it as a friend.
Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by worksonmine on Saturday March 28, 2026 @02:40PM (#47557175)
It doesn't try to do anything. It doesn't work like that. It regurgitates the most likely tokens found in the training set.
Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by nuancebydefault on Saturday March 28, 2026 @03:20PM (#47557447)
Hmmmm i didn't know that... so a machine is not human is your point? Look, i know it doesn't try, just like a sorting algo does not try to sort, or an article does not try to convey an opinion and a law does not try to make society more organized.
Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by cruffle_duffle on Saturday March 28, 2026 @03:22PM (#47557453)
That is so reductive of an analysis that it is almost worthless. Technically true, but very unhelpful in terms of using an LLM.

It is a first principle though so it helps to “stir the context windows pot” by having it pull in research and other shit on the web that will help ground it and not just tell you exactly what you prompt it to say.

Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by worksonmine on Saturday March 28, 2026 @05:01PM (#47558075)
They are amazing tools, but when people try to give them agency someone has to explain it in simple terms.
Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by Forgeties79 on Saturday March 28, 2026 @05:58PM (#47558485)
>in an objective way

One of the great myths of models in countless fields/industries. LLM’s are absolutely in no way objective.

Now if you want to say it’s an “outside opinion“ that’s valid. But do not kid yourself into thinking it is somehow empirical or objective

Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by astrange on Saturday March 28, 2026 @01:22PM (#47556591)
Claudes have lots of empathy. The issue is the opposite - it isn't very good at challenging you and it's not capable of independently verifying you're not bullshitting it or lying about your own situation.

But it's better than talking to yourself or an abuser!

Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by bloomca on Saturday March 28, 2026 @01:37PM (#47556708)
It's about the same as talking to yourself, LLMs simply agree with anything you say unless it is directly harmful. Definitely agree about talking to an abuser, though.

Sometimes people indeed just need validation and it helps them a lot, in that case LLMs can work. Alternatively, I assume some people just put the whole situation into words and that alone helps.

But if someone needs something else, they can be straight up dangerous.

Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by astrange on Saturday March 28, 2026 @02:18PM (#47557027)
> It's about the same as talking to yourself, LLMs simply agree with anything you say unless it is directly harmful.

They have world knowledge and are capable of explaining things and doing web searches. That's enough to help. I mean, sometimes people just need answers to questions.

Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by JoshTriplett on Saturday March 28, 2026 @02:36PM (#47557152)
> It's about the same as talking to yourself

In one way it's potentially worse than talking to yourself. Some part of you might recognize that you need to talk to someone other than yourself; an LLM might make you feel like you've done that, while reinforcing whatever you think rather than breaking you out of patterns.

Also, LLMs can have more resources and do some "creative" enabling of a person stuck in a loop, so if you are thinking dangerous things but lack the wherewithal to put them into action, an LLM could make you more dangerous (to yourself or to others).

Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by DrewADesign on Saturday March 28, 2026 @12:46PM (#47556234)
Using an LLM for therapy is like using an iPad as an all-purpose child attention pacifier. Sure, it’s convenient. Sure there’s no immediate harm. Why a stressed parent would be attracted to the idea is obvious… and of course it’s a terrible idea.
Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by wiseowise on Sunday March 29, 2026 @04:11AM (#47561267)
Using LLM for therapy is like using iPad as a study assistance. It doesn’t replace your work.
Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by DrewADesign on Sunday March 29, 2026 @07:00AM (#47562088)
It’s nothing like that. Using an iPad for study assistance is a conduit to many credible sources and tools. They can be evaluated using context, reputation, reviews, etc.

An LLM generates non-deterministic information using sources you can’t even know, let alone evaluate, and is more primed to agree with you than give critical and objective evaluation. It is, at best, like asking your closest parent to help you through difficult interpersonal situations: The interaction is probably, subconsciously, going to be skewed enough towards soothing you that you just can’t consider it objective. The difference is that with an LLM, that’s deliberate. It’s designed in.

Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by brookside on Saturday March 28, 2026 @11:22PM (#47560119)
Therapy can be basically paid (I would argue - false) empathy, and in many cases vastly inferior to less transactional relationships.
Re:AI chatbots are "Yes-Men" that reinforce bad relationship... by ycombinator_acc on Saturday March 28, 2026 @11:47PM (#47560235)
Are you a therapist?