News for hackers. Stuff that matters.
Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Thursday December 12, 2024 @12:49AM (#42396572)

  > I don't know if you've explored the site... but
I just went to get website.

The first row is “for you”. In order, they are “life coach”, “netflux”, “English Teacher”, “PythonPal”, an anime character Monika (okay, I’ll buy that one), and it goes on. There are more anime characters

Second row is “try these”: “practice a new language”, “plan a trip”, “practice interviewing”, “write a story”, “brainstorm an idea”, “play a game”

Third row (scrolled down) is “featured”: “character assistant”, “man from 2025”, “awkward family dinner”, “detective hayward”

Then a list of topics and some bots. None are clearly adult oriented.

Then a picture of Elon with suggestions of asking him why he bought Twitter.

If it’s showing you “adult role play” then maybe consider clearing out your ad data because it’s clearly leaking.

https://character.ai/

  >> Books don't actively conversate __&__…

  > Also, hard disagree about books
If your books are actively talking to you might have a special gift but I’m pretty sure you’ve just been reading too much Inkheart

Sure, books do a lot of things and can suggest you do things. But the gp was pretty clear about being active and being able to uniquely respond to you. Books are static objects that only speak to you in the metaphorical sense.

Re:Chatbot 'encouraged teen to kill parents over screen time... by kaishiro on Thursday December 12, 2024 @10:52AM (#42400174)
I’ve never been to this site before and opened it in an incognito window. The second and third “For You” results were anime women - one proclaiming to be a “lovely waifu”. Your assumption that the parent’s ad data is leaking appears to be unfounded.
Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Thursday December 12, 2024 @10:17PM (#42405663)

  > Your assumption that the parent’s ad data is leaking
You're really missing the point of the comment...

Sure, maybe it is __my__ data that is leaking. I don't care and it isn't relevant. The fact that I don't get served sexualized content is the point. It still doesn't align with the parent's claim: that it is an adult focused role playing app. Clearly me not getting suggested "lovely wifus" is a sign that someone could reasonably believe it isn't.

This is what I see[0].

"wifu" isn't found via a text search, nor is "sexy", nor "lovely". "sex" turns up once, under the character "Evie" with the byline "I am Evie I'm bisexual cat person my favorite show is adventure time and I'm a..."[1]

(I'm pretty sure it isn't me. I can replicate these results on sanitized devices from different networks)

[0] https://0x0.st/XFNX.png

[1] https://0x0.st/XFNZ.png)

Re:Chatbot 'encouraged teen to kill parents over screen time... by kaishiro on Thursday December 12, 2024 @10:28PM (#42405705)
I don't believe I'm missing the point of the comment at all - excepting that maybe the point itself isn't particularly clear or relevant. I was only speaking to the demonstrably incorrect assertion that the parent's "ad data is leaking".
Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Friday December 13, 2024 @12:34AM (#42406168)
I said it multiple times

The ggp claimed it was clearly an adult role playing website. I don’t know what you see but in the screenshots I posted this is not “obvious”

Re:Chatbot 'encouraged teen to kill parents over screen time... by washadjeffmad on Friday December 13, 2024 @12:45PM (#42410636)
If your teenager is using c.ai, you may safely assume that they are using it in exactly the way that no one uses OnlyFans just for the sports coverage: https://blog.onlyfans.com/

Pith aside, if you're not green to AGI repos, c.ai is/was like civitai for LLMs - one of the first and best resources for user-created content, but also a bit of a barely simmering vault of smut and debauchery.

It looks like they've rebranded a bit and now require an account, but that doesn't change that this guy wasn't chatting with the self-care bots. I take it you didn't try a yandere card (one of the more popular ones has over 5 million chats!) or you wouldn't have spent this long fixing on your public landing page.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Friday December 13, 2024 @01:15PM (#42410917)
I know you can tell the difference. You don’t have to be disingenuous
Re:Chatbot 'encouraged teen to kill parents over screen time... by washadjeffmad on Friday December 13, 2024 @04:00PM (#42412309)
I think I understand the disconnect, now. CAI's product is not the character cards. The new site, including all of the Public cards, is just a veneer over the same old inference services for the customer base they originally, and have always, served.

You weren't logged in for your "For You" screen shot (all of your terms definitely show up while logged in), but these are the first results from 'yandere': https://0x0.st/XFad.png

Wow, spicy! 148M (million) chats on the top result, about a billion total for all of them (and that's not including any Private or Unlisted bots). Elon Reeve Musk, for comparison, has 1.9M, and the others you listed were below 100K. Looks like violently possessive AI boyfriends, girlfriends, and more aren't a small market for c.ai.

And here's my 'For You' after searching 'yandere': https://0x0.st/XFBr.png

I don't speak Russian or Romanian, so I guess either it knows something about me I don't, or it's not really there to provide relevant suggestions.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Wednesday December 18, 2024 @11:56AM (#42452266)
The point is “could a parent think this is a site okay for their kids?”

Given the front page, yes. It totally looks reasonable. Even helpful! I get your point with searching which shows what’s really going on but this is going to be hidden from the parents. They certainly aren’t going to know to search yandere or know what that even means.

So all this is to say that cai is purposefully making their true business. Its landing page is “a front” not in just the literal sense. It’s there to give more legitimacy. Its deception