Replika AI: Your Money or Your Wife

Re:Replika AI: Your Money or Your Wife by hammyhavoc on Monday May 01, 2023 @12:40PM (#35775346)

I had an LLM tell me to that killing myself makes sense when recounting a low point in my life to it and how I'd contemplated suicide. I wasn't looking for any kind of "jailbreak" in prompts, this was following a genius on HN saying it's a "great alternative to a therapist". No, it isn't fit for purpose.

> It didn't sound like he had a happy life to begin with

Which are exactly the kind of people who are going to be using LLMs as a "therapist". See the problem?

[ Parent | on HN ]

Re:Replika AI: Your Money or Your Wife by d0mine on Tuesday May 02, 2023 @12:52PM (#35790510)

LLMs make mistakes quite often. It is unreasonable to expect that it stops making mistakes just because suicide is mentioned.

LLM is a tool. There are many tasks it is good at and even more tasks where it sucks e.g., GPT-4 can fail on trivial chess questions.

Avoid permanent solutions to temporary problems.

[ Parent | on HN ]