Re:Chatbot 'encouraged teen to kill parents over screen time...
by JumpCrisscross on Thursday December 12, 2024 @08:01AM
(#42398787)
> remarkably few use cases, it turns out, where that is okay; you really need it to _not matter at all_ if the output is arbitrarily wrong
It's probably true in most cases. Those cases don't cover kids.
Re:Chatbot 'encouraged teen to kill parents over screen time...
by rsynnott on Thursday December 12, 2024 @08:44AM
(#42399065)
I think there are a lot of cases where it _seems_ to be true, until you think through the details. Most cases where it actually _is_ true are, in practice, very low impact; the big proven one seems to be, essentially, generation of high-volume spam content.
(I suspect character.ai was originally conceived precisely because it appeared to be a usecase where LLM unreliability would be okay, the creators not having thought sufficiently carefully about it.)