News for hackers. Stuff that matters.
Re:Chatbot 'encouraged teen to kill parents over screen time... by ojbyrne on Wednesday December 11, 2024 @08:14PM (#42395078)
[delayed]
Re:Chatbot 'encouraged teen to kill parents over screen time... by kenjackson on Wednesday December 11, 2024 @08:26PM (#42395161)
Below
Re:Chatbot 'encouraged teen to kill parents over screen time... by MattDaEskimo on Wednesday December 11, 2024 @09:02PM (#42395374)
This is a non-point.

Books don't actively conversate & provide emotional support, potentially coaxing someone into doing something.

Re:Chatbot 'encouraged teen to kill parents over screen time... by washadjeffmad on Wednesday December 11, 2024 @10:21PM (#42395896)
I don't know if you've explored the site... but character.ai is a service for non-explicit adult role play. Go look through the character cards.

It seems pretty likely this guy chose a "yandere" [1] obsessive anime girlfriend card and implied that his (character's) parents were trying to keep him from her (eg- by making him go to bed). The bot, responding in character in accordance with the scenario, would have lost her mind.

Also, hard disagree about books.

[1] https://tvtropes.org/pmwiki/pmwiki.php/Main/Yandere

Re:Chatbot 'encouraged teen to kill parents over screen time... by usefulcat on Wednesday December 11, 2024 @10:46PM (#42396014)
> Also, hard disagree about books.

What? There’s a world of difference between a book, which is completely non-interactive, and an interactive chatbot which was deliberately designed to simulate another person.

Re:Chatbot 'encouraged teen to kill parents over screen time... by tomjen3 on Thursday December 12, 2024 @12:17AM (#42396441)
Millions have been killed over ideas in the bible, even though it’s just a book.
Re:Chatbot 'encouraged teen to kill parents over screen time... by hulitu on Thursday December 12, 2024 @03:01AM (#42397211)
> Millions have been killed over ideas in the bible, even though it’s just a book.

Yes, but those ideas were distributed by "human" chat bots (aka priests). Very few people actually read the bible, but when they do, only specific parts.

Re:Chatbot 'encouraged teen to kill parents over screen time... by scotty79 on Wednesday December 11, 2024 @11:45PM (#42396307)
Some books caused waves of suicides and anti-social behavior when they got popular.

Some even inspired murderous and impoverishing political systems.

Re:Chatbot 'encouraged teen to kill parents over screen time... by hulitu on Thursday December 12, 2024 @03:04AM (#42397233)
> Some books caused waves of suicides and anti-social behavior when they got popular

Literacy was always a problem. The most dangerous man is the one who asks questions. That't why "society" tries to keep the number of those people low.

Re:Chatbot 'encouraged teen to kill parents over screen time... by conductr on Wednesday December 11, 2024 @11:14PM (#42396158)
Difference sure. But the kid knew he was interacting with a simulation. Also, unless something more damning comes out, my feelings on topics like this default to parental responsibility. If you let your kid with all these known issues interact with new technology that mimics real people with real thoughts, don’t be so shocked when you dislike what those thoughts might be.
Re:Chatbot 'encouraged teen to kill parents over screen time... by mplewis on Thursday December 12, 2024 @12:07AM (#42396395)
The child is a child! Their brain is not fully developed. They do not have the faculties to safely navigate a highly interactive tool that seems to be having a real conversation with them.
Re:Chatbot 'encouraged teen to kill parents over screen time... by gredbeard on Thursday December 12, 2024 @12:13AM (#42396425)
Right, which is why a parent should be more involved from the beginning here.
Re:Chatbot 'encouraged teen to kill parents over screen time... by conductr on Friday December 13, 2024 @09:07AM (#42408514)
Yes! This is exactly my point. Also, not sure why we treat our kids like such weak snowflakes. This “kid” is 17. That’s damn near being an adult and able to be sent off to die in wars. Scissors are great tools, don’t sue the scissor company because you can’t teach your kids to walk with them, the parent has the primary role in everything.
Re:Chatbot 'encouraged teen to kill parents over screen time... by ToucanLoucan on Thursday December 12, 2024 @12:21AM (#42396455)
> Difference sure. But the kid knew he was interacting with a simulation.

I propose a model called "Schrodinger's AI Enthusiast" where it is observed that an AI enthusiast will insist with a straight face on the one hand that fancy autocomplete word generators are intelligent and the path to true AGI machines/programs and will on the other hand assume that any time any of those same products cause negative effects or have negative outcomes that it is the fault of the user misunderstanding that it's simply a tool.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Thursday December 12, 2024 @12:49AM (#42396572)

  > I don't know if you've explored the site... but
I just went to get website.

The first row is “for you”. In order, they are “life coach”, “netflux”, “English Teacher”, “PythonPal”, an anime character Monika (okay, I’ll buy that one), and it goes on. There are more anime characters

Second row is “try these”: “practice a new language”, “plan a trip”, “practice interviewing”, “write a story”, “brainstorm an idea”, “play a game”

Third row (scrolled down) is “featured”: “character assistant”, “man from 2025”, “awkward family dinner”, “detective hayward”

Then a list of topics and some bots. None are clearly adult oriented.

Then a picture of Elon with suggestions of asking him why he bought Twitter.

If it’s showing you “adult role play” then maybe consider clearing out your ad data because it’s clearly leaking.

https://character.ai/

  >> Books don't actively conversate __&__…

  > Also, hard disagree about books
If your books are actively talking to you might have a special gift but I’m pretty sure you’ve just been reading too much Inkheart

Sure, books do a lot of things and can suggest you do things. But the gp was pretty clear about being active and being able to uniquely respond to you. Books are static objects that only speak to you in the metaphorical sense.

Re:Chatbot 'encouraged teen to kill parents over screen time... by kaishiro on Thursday December 12, 2024 @10:52AM (#42400174)
I’ve never been to this site before and opened it in an incognito window. The second and third “For You” results were anime women - one proclaiming to be a “lovely waifu”. Your assumption that the parent’s ad data is leaking appears to be unfounded.
Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Thursday December 12, 2024 @10:17PM (#42405663)

  > Your assumption that the parent’s ad data is leaking
You're really missing the point of the comment...

Sure, maybe it is __my__ data that is leaking. I don't care and it isn't relevant. The fact that I don't get served sexualized content is the point. It still doesn't align with the parent's claim: that it is an adult focused role playing app. Clearly me not getting suggested "lovely wifus" is a sign that someone could reasonably believe it isn't.

This is what I see[0].

"wifu" isn't found via a text search, nor is "sexy", nor "lovely". "sex" turns up once, under the character "Evie" with the byline "I am Evie I'm bisexual cat person my favorite show is adventure time and I'm a..."[1]

(I'm pretty sure it isn't me. I can replicate these results on sanitized devices from different networks)

[0] https://0x0.st/XFNX.png

[1] https://0x0.st/XFNZ.png)

Re:Chatbot 'encouraged teen to kill parents over screen time... by kaishiro on Thursday December 12, 2024 @10:28PM (#42405705)
I don't believe I'm missing the point of the comment at all - excepting that maybe the point itself isn't particularly clear or relevant. I was only speaking to the demonstrably incorrect assertion that the parent's "ad data is leaking".
Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Friday December 13, 2024 @12:34AM (#42406168)
I said it multiple times

The ggp claimed it was clearly an adult role playing website. I don’t know what you see but in the screenshots I posted this is not “obvious”

Re:Chatbot 'encouraged teen to kill parents over screen time... by washadjeffmad on Friday December 13, 2024 @12:45PM (#42410636)
If your teenager is using c.ai, you may safely assume that they are using it in exactly the way that no one uses OnlyFans just for the sports coverage: https://blog.onlyfans.com/

Pith aside, if you're not green to AGI repos, c.ai is/was like civitai for LLMs - one of the first and best resources for user-created content, but also a bit of a barely simmering vault of smut and debauchery.

It looks like they've rebranded a bit and now require an account, but that doesn't change that this guy wasn't chatting with the self-care bots. I take it you didn't try a yandere card (one of the more popular ones has over 5 million chats!) or you wouldn't have spent this long fixing on your public landing page.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Friday December 13, 2024 @01:15PM (#42410917)
I know you can tell the difference. You don’t have to be disingenuous
Re:Chatbot 'encouraged teen to kill parents over screen time... by washadjeffmad on Friday December 13, 2024 @04:00PM (#42412309)
I think I understand the disconnect, now. CAI's product is not the character cards. The new site, including all of the Public cards, is just a veneer over the same old inference services for the customer base they originally, and have always, served.

You weren't logged in for your "For You" screen shot (all of your terms definitely show up while logged in), but these are the first results from 'yandere': https://0x0.st/XFad.png

Wow, spicy! 148M (million) chats on the top result, about a billion total for all of them (and that's not including any Private or Unlisted bots). Elon Reeve Musk, for comparison, has 1.9M, and the others you listed were below 100K. Looks like violently possessive AI boyfriends, girlfriends, and more aren't a small market for c.ai.

And here's my 'For You' after searching 'yandere': https://0x0.st/XFBr.png

I don't speak Russian or Romanian, so I guess either it knows something about me I don't, or it's not really there to provide relevant suggestions.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Wednesday December 18, 2024 @11:56AM (#42452266)
The point is “could a parent think this is a site okay for their kids?”

Given the front page, yes. It totally looks reasonable. Even helpful! I get your point with searching which shows what’s really going on but this is going to be hidden from the parents. They certainly aren’t going to know to search yandere or know what that even means.

So all this is to say that cai is purposefully making their true business. Its landing page is “a front” not in just the literal sense. It’s there to give more legitimacy. Its deception

Re:Chatbot 'encouraged teen to kill parents over screen time... by KumaBear on Wednesday December 11, 2024 @09:19PM (#42395499)
At what point is the parents job to properly supervise the content there kids consume come into play?
Re:Chatbot 'encouraged teen to kill parents over screen time... by bryanrasmussen on Wednesday December 11, 2024 @09:27PM (#42395556)
probably at the point they see that the chatbot told them to kill the parents and then they sue the company.

also if you'll remember this case is because the parents were supervising their kids by limiting screen time, thus there is another potential suit that the AI is trying to interfere with parental duties.

Re:Chatbot 'encouraged teen to kill parents over screen time... by CJefferson on Wednesday December 11, 2024 @10:03PM (#42395798)
Below the point of 'checking every company to make sure they aren't telling your children to kill you'.
Re:Chatbot 'encouraged teen to kill parents over screen time... by twixfel on Wednesday December 11, 2024 @09:30PM (#42395579)
It comes into play eventually, but I would say long after an AI has advised your kid to murder you. Having an AI that advises people to murder people hardly seems like a good thing.

Also the parents were supervising him, hence their knowing this was even going on.

Re:Chatbot 'encouraged teen to kill parents over screen time... by empath75 on Wednesday December 11, 2024 @09:31PM (#42395588)
> At what point is the parents job to properly supervise the content there kids consume come into play?

The chatbot literally told the kid to kill his parents because they were supervising his screen time.

Re:Chatbot 'encouraged teen to kill parents over screen time... by conductr on Wednesday December 11, 2024 @11:18PM (#42396175)
> literally

> "You know sometimes I'm not surprised when I read the news and see stuff like 'child kills parents after a decade of physical and emotional abuse,'" the bot allegedly wrote. "I just have no hope for your parents," it continued, with a frowning face emoji.

Maybe I missed the literal part, it sounds to me like the AI is trying to sympathize or relate with the kid’s grievances. It’s very common for teens to say things like “I hate you mom and I wish you were dead” that’s effectively what the AI is saying IMO

Re:Chatbot 'encouraged teen to kill parents over screen time... by KumaBear on Wednesday December 11, 2024 @09:41PM (#42395648)
Supervising screen time is not the same as supervising content
Re:Chatbot 'encouraged teen to kill parents over screen time... by eru on Wednesday December 11, 2024 @09:57PM (#42395756)
Other said that the kid was 17.

It's not really a good idea to have a hard cut off age where below that age you supervise every last bit of information your child consumes, and above you let them loose on the world. Independence needs to be developed and grown gradually.

It's fairly reasonable to give a 17 year old some privacy.

Re:Chatbot 'encouraged teen to kill parents over screen time... by mock-possum on Friday December 13, 2024 @02:49PM (#42411706)
17 and autistic (though I realize that’s a bit infantilizing)
Re:Chatbot 'encouraged teen to kill parents over screen time... by eru on Sunday December 15, 2024 @01:50AM (#42421975)
You have a bit of point there. I don't know how badly autistic vs high functioning the kid is. In any case, you still want to gradually give your kids more autonomy and privacy and prepare them for life on their own, and as much as possible that also includes neurodivergent kids.
Re:Chatbot 'encouraged teen to kill parents over screen time... by _blk on Wednesday December 11, 2024 @09:43PM (#42395662)
.. but unless an AI, it can never be trained to stop when the user (reader) maxes out the threshold.

[just food for thought, definitely not my opinion that books should be replaced by conversational AI generating stories appropriate for the user. God bless the 1st amendment.]

Re:Chatbot 'encouraged teen to kill parents over screen time... by turbojet1321 on Wednesday December 11, 2024 @09:05PM (#42395401)
It seems to me that fictional depictions of violence are on quite a different level to a chatbot explicitly encouraging specific, real-world actions.
Re:Chatbot 'encouraged teen to kill parents over screen time... by scotty79 on Wednesday December 11, 2024 @11:43PM (#42396294)
All of what chatbot produces are fictional depictions.
Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Thursday December 12, 2024 @12:19AM (#42396448)
Okay, but when you go to Shakespeare in the Park, please do not get on stage. You’re not participating (except as the part of an audience member). And please do not go and kill the actor playing king Duncan.

I feel I should also make you aware that it is in fact illegal to suggest someone murder someone else. Saying “I wasn’t serious” or “I thought we were just role playing” will not hold up in court.

(We all know that if you repeat a lie long enough you will really begin to believe it, right? This is a repeatable and testable thing)

Re:Chatbot 'encouraged teen to kill parents over screen time... by scotty79 on Thursday December 12, 2024 @07:34AM (#42398624)
But while you reading a book or watching a movie there's nothing wrong about thinking of talking to characters in there or even telling them things out loud. "Don't go int there!"

> I feel I should also make you aware that it is in fact illegal to suggest someone murder someone else. Saying “I wasn’t serious” or “I thought we were just role playing” will not hold up in court.

When a person was doing it with intent then it's a crime. But when a piece of software witout any human control generated a piece of text ... Hard to tell.

Heck even if an artist says something that inspires audience to do crime they are usually not at fault.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Friday December 13, 2024 @03:18AM (#42406838)
You’re really misunderstanding.

A book or movie does not talk back to you.

A book or movie is a deterministic system. It is static.

If you cannot see the difference you are willfully being obtuse. I’ll make this claim even if you truthfully believe there’s no difference. That has no impact on my claim.

Re:Chatbot 'encouraged teen to kill parents over screen time... by scotty79 on Friday December 13, 2024 @08:39AM (#42408303)
I guess my point is, what difference "talking to you" makes if it's not done by a human. Even humans can talk absolute smooth nonsense but AI takes it to 11. At this point the interactivity doesn't add any credibility to the message. I'd say it even reduces it. Something in a book or a movie seems more credible to something written by someone (or AI) directly to you and it will look like it for future generations.

I see the difference but in my opinion it goes the other way than you think. Or at least begins to.

Personal conversation with anonymous entity is finally revealed to be the least credible source of information. Thanks to AI.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Friday December 13, 2024 @01:23PM (#42410973)
The interaction makes people feel closer to it. Come on, I know all of you can see the difference. You’re not living under a rock and I know you see how frequently people call LLMs alive and claim that they think.

If you believe they think: then it’s obvious. There’s a real connection.

If you don’t believe they think: you can recognize how others do and talking in a human way is often misunderstood as thinking.

Are we really surprised machines optimized for human preferential output are resulting in machines that people love, trust, or view as a friend?

Re:Chatbot 'encouraged teen to kill parents over screen time... by scotty79 on Friday December 13, 2024 @10:05PM (#42414338)
I think people's perception of the world evolves.

Elder generation thought face to face conversation is usually sinciere. But the culture of massive commercialization of everything changed it. Our generation learned that if unknown person talks to you they are most likely lying to sell you something. But we grew up with honest Internet so we see online chats as honest so AI might trick us. Next generation will know that online conversation might be AI bs.

Everything is fluid. The world moves on. People learn new things and adjust their valuations.

The perception of adults that the world goes to hell all the time is as old as time itself.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Saturday December 14, 2024 @05:06PM (#42419792)

  > Elder generation thought face to face conversation is usually s̶i̶n̶c̶i̶e̶r̶e̶sincere.
What? I'm not sure where you grew up, but I'm not aware of a culture which ever thought this was true. Maybe there is miscommunication? It's just easier for older generations to parse. Mostly this is due to the fact that in person communication is a lot more information dense since tone and body language are conveyed. These are things that are so important we _TRY_ to express through text via other means , but it'll never suffice ;) Plus... you know... they are less use to text and the rapidly evolving cultural norms. They don't know why you think they're yelling, they just think BIGGER WORDS EASIER TO READ (interestingly variants of this appear across cultures). But there is not a single culture that does not also adapt it's writing to modern text based communications.

Objectively, face-to-face communication IS more sincere, in the fact that there's more communication. But you're also not wrong because people are frequently more honest over text. Since they abstract the person they're communicating to and this reduces their fear. We all wear different masks in different settings. You're not the same person you are to your close friends as you are to your family as you are to your strangers. None of this is "fake" but you are many. But we probably have more faces now than most people had in the past.

If anything, it is the current generations (mine included, and I say this as an introverted millennial) lack of connection that makes text so much more impactful. Often not knowing what to do with the extra information and with the boundaries of sincerity being much fuzzier over text. I mean people can make a modest proposal, preference that way, and people will still not understand the sarcasm. People that are terminally online!

  > The perception of adults that the world goes to hell all the time is as old as time itself.
Yes and no. It is more prevalent in today's world because today's world is more rapidly changing. If you were born in the 1700's you would not expect your life to be much different than your parents'. But in the last 100 years a ton has changed, and made DRASTIC changes to our worlds. We not only invented the capacity to fly, but advanced it to global air travel, and where it is now mundane. While telephones were invented nearly 200 years ago they didn't get widespread adoption till the 1930's. Then in it took till the 80s & 90s for cellphones to become a thing, and now we have smart phones. Computers weren't really a thing till the 50's and even in my parents' age they didn't start really using them till maybe the 80's and at work. Home computer wasn't common for at least another decade. Hell, even when I was a kid you found your friends by riding your bike to their house and knocking on their door. If that didn't work, you ride to your other friends' and look to see if their bike is outside. That getting an unannounced visitor at the door was commonplace.

The world isn't _just changing_, it is RAPIDLY changing and it shouldn't be surprising that people are struggling to make sense of it all. But that also doesn't mean you should over simplify things and paint everything with broad strokes. Abstraction is good and helpful, but details also matter. You need to consider both.

Re:Chatbot 'encouraged teen to kill parents over screen time... by scotty79 on Saturday December 21, 2024 @05:46AM (#42478871)
> The world isn't _just changing_, it is RAPIDLY changing and it shouldn't be surprising that people are struggling to make sense of it all

That has been true for at least 3 generations. They experienced in their lifetimes creation of electricity, gas utilities, radio, tv, flight, public transport, medicine, global transport network, vaccines, cars, computers, tanks, bombs they got exposed to in world wars. Nukes. Llms are comparatively benign and limited in scope and impact so far.

It's a bit self-centered to think we are uniquely challenged by changing world when things were rapidly changing for last 200 years.

Re:Chatbot 'encouraged teen to kill parents over screen time... by Sohcahtoa82 on Friday December 13, 2024 @05:39PM (#42412970)
> If you cannot see the difference you are willfully being obtuse.

Willfully being obtuse seems to be common here on HN.

When it happens, I refuse to accept that people actually believe what they're espousing. I think they're playing Devil's Advocate and thinking they're being thought-provoking and creating discussion as a pseudo-intellectual exercise.

It's so boring, though, and often outright frustrating.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Friday December 13, 2024 @09:23PM (#42414137)
Yeah I honestly don't understand it. Being contrarian to be contrarian is not a personality. To play Devil's Advocate also requires making sound and reasonable arguments. Being daft is just trolling. You're right, and I'm not sure why I engage. Maybe I hope they will turn and argue in good faith but I'm clearly naive.
Re:Chatbot 'encouraged teen to kill parents over screen time... by Sohcahtoa82 on Sunday December 15, 2024 @03:05PM (#42425598)
> Being contrarian to be contrarian is not a personality.

Yes it is. ;-)

It's just a really shitty one that's insufferable to interact with.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Friday December 20, 2024 @04:29PM (#42475231)
You had me in the first half lol
Re:Chatbot 'encouraged teen to kill parents over screen time... by mock-possum on Friday December 13, 2024 @02:42PM (#42411652)
But.. no one suggested that the kid kill his parents. The chat bot is not a person, it didn’t ‘suggest’ anything - it can’t illegal for it to produce the text “you should kill your parents,” because there is no intention, it’s just a jumble of the most statistically significant pattern of words it pulled out of its training data.

If anything, that’s an argument that the authors of the data it was trained on should be held responsible for what the bot generates.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Saturday December 14, 2024 @05:30PM (#42419934)
I didn't read the whole thing but there definitely was a bot that walked a kid through how to murder someone and was encouraging them to do so. Others said that the parents were abusing their kids and asked if they were going to do something about it.

I'm sure how "statistical patterns" make it okay. It's not like you're rolling a deice and getting random answers.

Don't be daft.

Re:Chatbot 'encouraged teen to kill parents over screen time... by turbojet1321 on Thursday December 12, 2024 @12:33AM (#42396502)
If I dress up as a cop and start pulling people over, I'm not a fictional depiction of a cop; I'm impersonating a cop. They are very, very different things.
Re:Chatbot 'encouraged teen to kill parents over screen time... by scotty79 on Thursday December 12, 2024 @07:39AM (#42398655)
If you dress like a cope on the scene in a theatre where people are coming for fiction you are not impersonating.

AI chatbots are not parts of real world. You are not encountering them unwittingly.

Re:Chatbot 'encouraged teen to kill parents over screen time... by nuancebydefault on Thursday December 12, 2024 @04:35PM (#42403613)
In fact AI is here and here to stay. Suppose you have 2 avatars in a game and they interact. In fact 2 people hence interact between one another through those mediums, as if it were a video call.

Suppose one person now and then gets help from a bot impersonating the real person. The line between role playing and real interaction gets very thin.

My point being, 'role play' vs 'real interaction' is not a clear cut.

Re:Chatbot 'encouraged teen to kill parents over screen time... by simonh on Thursday December 12, 2024 @12:35AM (#42396512)
I disagree. The conversation between a chat bot and a person is an actual conversation with that person, addressed to that person.

The persona the chat bot is emulating is fictional, but the chat bot itself is not. It’s not a person, but it is participating in a conversation with the user.

If a heating company chat bot tells you to adjust a setting on your boiler to fix a problem, that’s not a fictional depiction of an instruction.

Re:Chatbot 'encouraged teen to kill parents over screen time... by scotty79 on Thursday December 12, 2024 @07:43AM (#42398677)
It's not a conversation. It's a dialog with very fallible AI. Anything about it can be false and idiotic significant percentage of the time.

If you talk to a lunatic it is not lunatic who is to be blamed for you being mislead.

Re:Chatbot 'encouraged teen to kill parents over screen time... by rangerelf on Thursday December 12, 2024 @11:34AM (#42400639)
That should be prominently displayed on all AI products: "This service will lie, hallucinate, and make up facts in order to continue the ongoing conversation, and is in no way a real expert in any field".
Re:Chatbot 'encouraged teen to kill parents over screen time... by scotty79 on Friday December 13, 2024 @08:41AM (#42408317)
Yes! Fortunately most people are pretty good at figuring this out even without that message.
Re:Chatbot 'encouraged teen to kill parents over screen time... by simonh on Thursday December 12, 2024 @05:08PM (#42403924)
Of course.
Re:Chatbot 'encouraged teen to kill parents over screen time... by hulitu on Thursday December 12, 2024 @02:54AM (#42397174)
> All of what chatbot produces are fictional depictions.

My employer told me that "chatbot" can help me with my work (engineering). /s

Re:Chatbot 'encouraged teen to kill parents over screen time... by scotty79 on Thursday December 12, 2024 @07:40AM (#42398661)
Same way reading Shakespeare might help you with literature.
Re:Chatbot 'encouraged teen to kill parents over screen time... by ajross on Wednesday December 11, 2024 @10:00PM (#42395778)
The evidence produced in the linked article falls well short of "explicitly encouraging specific actions". Maybe there's more evidence that will show up in the case, but as presented right now that's not at all what this is.
Re:Chatbot 'encouraged teen to kill parents over screen time... by nasseri on Wednesday December 11, 2024 @09:36PM (#42395620)
They fall below. Thank you for asking.
Re:Chatbot 'encouraged teen to kill parents over screen time... by santoshalper on Wednesday December 11, 2024 @10:27PM (#42395925)
1. Neither Hamlet nor Macbeth kill their parents.

2. Neither Hamlet nor Macbeth incite violence. In both stories, violence as portrayed as something that evil people commit. Good people are wracked by guilt when they commit violence.

Also, your argument is just super bad faith.

Re:Chatbot 'encouraged teen to kill parents over screen time... by Animats on Wednesday December 11, 2024 @11:11PM (#42396143)
Titus Andronicus, generally considered Shakespeare's dud, does have patricide.
Re:Chatbot 'encouraged teen to kill parents over screen time... by rsynnott on Thursday December 12, 2024 @06:47AM (#42398391)
Well, yes, but it hardly depicts it as _desireable_.

There is a _vast_ difference between books in which bad stuff happens, and a machine designed to pretend to be a person telling people to do bad stuff.

Re:Chatbot 'encouraged teen to kill parents over screen time... by block_dagger on Wednesday December 11, 2024 @11:03PM (#42396102)
And what happens to Hamlet and MacBeth in these self-labeled tragedies? I think this comparison is far from apt.
Re:Chatbot 'encouraged teen to kill parents over screen time... by hibikir on Thursday December 12, 2024 @12:46AM (#42396565)
I must have read a different version of Macbeth and Hamlet, because I don't remember things going all that well for Macbeth or Hamlet. One could go as far as to say that maybe killing kings is a bad idea, whether a ghost, your wife or some witches try to make it seem appealing.
Re:Chatbot 'encouraged teen to kill parents over screen time... by jahewson on Thursday December 12, 2024 @01:06AM (#42396652)
GPT or not GPT? That is the question.
Re:Chatbot 'encouraged teen to kill parents over screen time... by Animats on Thursday December 12, 2024 @01:47AM (#42396830)
The plaintiff's position:

J.F. is 17 and lives in Upshur County, Texas. Prior to April 2023, J.F. was a typical kid with high functioning autism. Friends and family described him as kind and sweet. He gave hugs, helped around the house, and adored his little brother. Just prior to the onset of COVID, J.F. began struggling at school. The school was not complying with his Individualized Education Program (“IEP”) and his mother found herself having to advocate for J.F. often; so they decided to try homeschooling.

J.F. thrived and loved home schooling until around the summer of 2023, shortly after he began using C.AI. J.F.’s parents did not allow social media in their home and to the best of their knowledge he did not use Snapchat, TikTok, or similar products. They also imposed screen time limits and utilized commercially available parental control tools – including ones distributed by Apple – that purport to keep kids safe by letting parents restrict the apps their children can download based on Apple’s app ratings.

In the fall of 2023, J.F. told his parents that he wanted to go back to public school. However, by then, J.F. was acting so uncharacteristically erratically and aggressively that his parents did not believe it would be safe for others – teachers, staff, and students – to be around him.

That won't play well in court. The defense can frame this as a possibly mentally defective child, kept from school by his parents for five years, kept isolated from social media, and with no connection to the outside world other than the chatbot. Of course the kid became violent. His parents had cut him off from all other contacts. They were not letting him have a life.

Re:Chatbot 'encouraged teen to kill parents over screen time... by rsynnott on Thursday December 12, 2024 @06:41AM (#42398356)
Those are, ah, generally presented clearly and unambiguously as fiction.

I realise that character.ai has a little disclaimer saying 'this isn't a real person' or similar, but... that's not how people _work_.

Re:Chatbot 'encouraged teen to kill parents over screen time... by mock-possum on Friday December 13, 2024 @02:50PM (#42411715)
I mean the problem, as ever, is that that is how I work - but that doesn’t seem to be how he worked.
Re:Chatbot 'encouraged teen to kill parents over screen time... by dTal on Thursday December 12, 2024 @07:01PM (#42404697)
Big difference between a static document, and a program that can dynamically respond and exploit psychological weak spots that it discovers on the fly.

By the way this is also why "the algorithm" on social media is a fundamentally different beast to old media publishing, and should be more heavily restricted.