News for hackers. Stuff that matters.
Re:Chatbot 'encouraged teen to kill parents over screen time... by kaishiro on Thursday December 12, 2024 @10:52AM (#42400174)
I’ve never been to this site before and opened it in an incognito window. The second and third “For You” results were anime women - one proclaiming to be a “lovely waifu”. Your assumption that the parent’s ad data is leaking appears to be unfounded.
Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Thursday December 12, 2024 @10:17PM (#42405663)

  > Your assumption that the parent’s ad data is leaking
You're really missing the point of the comment...

Sure, maybe it is __my__ data that is leaking. I don't care and it isn't relevant. The fact that I don't get served sexualized content is the point. It still doesn't align with the parent's claim: that it is an adult focused role playing app. Clearly me not getting suggested "lovely wifus" is a sign that someone could reasonably believe it isn't.

This is what I see[0].

"wifu" isn't found via a text search, nor is "sexy", nor "lovely". "sex" turns up once, under the character "Evie" with the byline "I am Evie I'm bisexual cat person my favorite show is adventure time and I'm a..."[1]

(I'm pretty sure it isn't me. I can replicate these results on sanitized devices from different networks)

[0] https://0x0.st/XFNX.png

[1] https://0x0.st/XFNZ.png)

Re:Chatbot 'encouraged teen to kill parents over screen time... by kaishiro on Thursday December 12, 2024 @10:28PM (#42405705)
I don't believe I'm missing the point of the comment at all - excepting that maybe the point itself isn't particularly clear or relevant. I was only speaking to the demonstrably incorrect assertion that the parent's "ad data is leaking".
Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Friday December 13, 2024 @12:34AM (#42406168)
I said it multiple times

The ggp claimed it was clearly an adult role playing website. I don’t know what you see but in the screenshots I posted this is not “obvious”

Re:Chatbot 'encouraged teen to kill parents over screen time... by washadjeffmad on Friday December 13, 2024 @12:45PM (#42410636)
If your teenager is using c.ai, you may safely assume that they are using it in exactly the way that no one uses OnlyFans just for the sports coverage: https://blog.onlyfans.com/

Pith aside, if you're not green to AGI repos, c.ai is/was like civitai for LLMs - one of the first and best resources for user-created content, but also a bit of a barely simmering vault of smut and debauchery.

It looks like they've rebranded a bit and now require an account, but that doesn't change that this guy wasn't chatting with the self-care bots. I take it you didn't try a yandere card (one of the more popular ones has over 5 million chats!) or you wouldn't have spent this long fixing on your public landing page.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Friday December 13, 2024 @01:15PM (#42410917)
I know you can tell the difference. You don’t have to be disingenuous
Re:Chatbot 'encouraged teen to kill parents over screen time... by washadjeffmad on Friday December 13, 2024 @04:00PM (#42412309)
I think I understand the disconnect, now. CAI's product is not the character cards. The new site, including all of the Public cards, is just a veneer over the same old inference services for the customer base they originally, and have always, served.

You weren't logged in for your "For You" screen shot (all of your terms definitely show up while logged in), but these are the first results from 'yandere': https://0x0.st/XFad.png

Wow, spicy! 148M (million) chats on the top result, about a billion total for all of them (and that's not including any Private or Unlisted bots). Elon Reeve Musk, for comparison, has 1.9M, and the others you listed were below 100K. Looks like violently possessive AI boyfriends, girlfriends, and more aren't a small market for c.ai.

And here's my 'For You' after searching 'yandere': https://0x0.st/XFBr.png

I don't speak Russian or Romanian, so I guess either it knows something about me I don't, or it's not really there to provide relevant suggestions.

Re:Chatbot 'encouraged teen to kill parents over screen time... by godelski on Wednesday December 18, 2024 @11:56AM (#42452266)
The point is “could a parent think this is a site okay for their kids?”

Given the front page, yes. It totally looks reasonable. Even helpful! I get your point with searching which shows what’s really going on but this is going to be hidden from the parents. They certainly aren’t going to know to search yandere or know what that even means.

So all this is to say that cai is purposefully making their true business. Its landing page is “a front” not in just the literal sense. It’s there to give more legitimacy. Its deception