News for hackers. Stuff that matters.
Re:Paris prosecutors raid France offices of Elon Musk's X by exodust on Wednesday February 04, 2026 @03:45AM (#46883217)
I remember when CSAM meant actual children not computer graphics.

Should platforms allow violent AI images? How about "R-Rated" violence like we see in popular movies? Point blank executions, brutal and bloody conflict involving depictions of innocent deaths, torment and suffering... all good? Hollywood says all good, how about you? How far do you take your "unacceptable content" guidance?

Re:Paris prosecutors raid France offices of Elon Musk's X by myrmidon on Wednesday February 04, 2026 @04:32AM (#46883591)
There are multiple valid reasons to fight realistic computer-generated CSAM content.

Uncontrolled profileration of AI-CSAM makes detection of "genuine" data much harder, prosecution of perpetrators more difficult and specifically in many of the grok cases it harms young victims that were used as templates for the material.

Content is unacceptable if its proliferation causes sufficient harm, and this is arguably the case here.

Re:Paris prosecutors raid France offices of Elon Musk's X by Eisenstein on Wednesday February 04, 2026 @06:11AM (#46884397)
> Uncontrolled profileration of AI-CSAM makes detection of "genuine" data much harder

I don't follow. If the prosecutor can't find evidence of a crime and a person is not charged, that is considered harmful? As such the 5th amendment would fall under the same category and so would encryption. Making law enforcement have to work harder to find evidence of a crime cannot be criminalized unless you can come up with a reason why the actions themselves deserve to be criminalized.

> specifically in many of the grok cases it harms young victims that were used as templates for the material.

What is the criteria for this? If something is suitably transformed such that the original model for it is not discernable or identifiable, how can it harm them?

Do not take these as an argument against the idea you are arguing for, but as rebuttals against arguments that are not convincing, or if they were, would be terrible if applied generally.

Re:Paris prosecutors raid France offices of Elon Musk's X by myrmidon on Wednesday February 04, 2026 @06:52AM (#46884746)
If there is a glut of legal, AI generated CSAM material then this provides a lot of deniability for criminal creators/spreaders that cause genuine harm, and reduces "vigilance" of prosecutors, too ("it's probably just AI generated anyway...").

You could make a multitude of arguments against that perspective, but at least there is a conclusive reason for legal restrictions.

> What is the criteria for this?

My criteria would be victims suffering personally from the generated material.

The "no harm" argument only really applies if victims and their social bubble never find out about the material (but that did happen, sometimes intentionally, in many cases).

You could make the same argument that a hidden camera in a locker room never causes any harm as long as it stays undetected; that is not very convincing to me.

Re:Paris prosecutors raid France offices of Elon Musk's X by Eisenstein on Wednesday February 04, 2026 @07:33AM (#46885077)
> You could make a multitude of arguments against that perspective, but at least there is a conclusive reason for legal restrictions.

But that reason is highly problematic. Laws should be able to stand on their own for their reasons. Saying 'this makes enforcement of other laws harder' does not do that. You could use the same reasoning against encryption.

> You could make the same argument that a hidden camera in a locker room never causes any harm as long as it stays undetected; that is not very convincing to me.

I thought you were saying that the kids who were in the dataset that the model was trained on would be harmed. I agree with what I assume you meant based on your reply, which is people who had their likeness altered are harmed.

Re:Paris prosecutors raid France offices of Elon Musk's X by myrmidon on Wednesday February 04, 2026 @08:13AM (#46885427)
> Saying 'this makes enforcement of other laws harder' does not do that. You could use the same reasoning against encryption.

Yes. I almost completely agree with your outlook, but I think that many of our laws trade such individual freedoms for better society-wide outcomes, and those are often good tradeoffs.

Just consider gun legislation, driving licenses, KYC laws in finance, etc: Should the state have any business interfering there? I'd argue in isolation (ideally) not; but all those lead to huge gains for society, making it much less likely to be murdered by intoxicated drivers (or machine-gunners) and limit fraud, crime and corruption.

So even if laws look kinda bad from a purely theoretical-ethics point of view it's still important to look at the actual effects that they have before dismissing them as unjust in my view.

Re:Paris prosecutors raid France offices of Elon Musk's X by direwolf20 on Wednesday February 04, 2026 @08:38AM (#46885662)
Laws against money laundering come to kind. It's illegal for you to send money from your legal business to my personal account and for me to send it from my personal account to your other legal business, not because the net result is illegal, but because me being in the middle makes it harder for "law enforcement" to trace the transaction.
Re:Paris prosecutors raid France offices of Elon Musk's X by whilenot-dev on Wednesday February 04, 2026 @11:18AM (#46887709)
> Saying 'this makes enforcement of other laws harder' does not do that. You could use the same reasoning against encryption.

I don't understand how that's the same reasoning at all... Encryption serves ones individual privacy and preserves it against malicious actors. I'd guess that's a fundamental right in most jurisdictions, globally.

We're talking CSAM here and shifting its creation into the virtual world through some GenAI prompts. Just because that content has been created artificially, doesn't make its storage and distribution any more legal.

It isn't some reductionist "this makes enforcement of other laws harder", but it's rather that the illegal distribution of artificially generated content acts as fraudulent obstruction in the prosecution of authentic, highly illegal, content - content with malicious actors and physically affected victims.

Re:Paris prosecutors raid France offices of Elon Musk's X by guerrilla on Wednesday February 04, 2026 @09:38AM (#46886337)
> If there is a glut of legal, AI generated CSAM material then this provides a lot of deniability for criminal creators/spreaders that cause genuine harm, and reduces "vigilance" of prosecutors, too ("it's probably just AI generated anyway...").

> You could make a multitude of arguments against that perspective, but at least there is a conclusive reason for legal restrictions.

I don't know about that. Would "I didn't know it was real" really count as a legal defense?

Re:Paris prosecutors raid France offices of Elon Musk's X by myrmidon on Wednesday February 04, 2026 @09:46AM (#46886436)
> I don't know about that. Would "I didn't know it was real" really count as a legal defense?

Absolutely-- prosecution would presumably need to at least show that you could have known the material was "genuine".

This could be a huge legal boon for prosecuted "direct customers" and co-perpetrators that can only be linked via shared material.

Re:Paris prosecutors raid France offices of Elon Musk's X by guerrilla on Wednesday February 04, 2026 @12:56PM (#46889122)
I'm really not convinced. This sounds very idealistic to me. The "justice" system is way more brutal in real life.
Re:Paris prosecutors raid France offices of Elon Musk's X by KaiserPro on Wednesday February 04, 2026 @04:37AM (#46883643)
> I remember when CSAM meant actual children not computer graphics.

The "oh its photoshop" defence was an early one, which required the law to change in the uk to be "depictions" of children, so that people who talk about ebephiles don't have an out for creating/distributing illegal content.

Re:Paris prosecutors raid France offices of Elon Musk's X by master-lincoln on Wednesday February 04, 2026 @07:27AM (#46885037)
There still needs to be sexual abuse depicted, no? Just naked kids should not be an issue, right?
Re:Paris prosecutors raid France offices of Elon Musk's X by direwolf20 on Wednesday February 04, 2026 @08:38AM (#46885669)
Naked kid pictures intended for sexual gratification are illegal in most countries
Re:Paris prosecutors raid France offices of Elon Musk's X by master-lincoln on Wednesday February 04, 2026 @09:28AM (#46886209)
Hard to know the intent of a picture in most cases. E.g. there used to be a magazine for teens when I grew up showing a picture of a naked adolescent of each sex in every edition (Bravo Dr Sommer). The intent was to educate teens and to make them feel less ashamed. I bet there were people who used these for sexual gratification. Should that have been a reason to ban them? I don't think so.
Re:Paris prosecutors raid France offices of Elon Musk's X by mnewme on Wednesday February 04, 2026 @03:54PM (#46891629)
Educational nudity where the subject consented possible for teenagers over 16 in Germany (and the publication complied with the law) is not the same category as CSAM or non-consensual sexual imagery. In the former, misuse by a minority doesn’t automatically make the publication illegal. In the latter, the harm is intrinsic: a child cannot legally consent, and non-consensual sexual images are a direct rights violation.
Re:Paris prosecutors raid France offices of Elon Musk's X by direwolf20 on Wednesday February 04, 2026 @04:37PM (#46892147)
Do you think the judge is stupid? The naked kid pics aren't printed in an anatomical textbook. Because they're AI hallucinations, I doubt they're even anatomically correct.
Re:Paris prosecutors raid France offices of Elon Musk's X by paintbox on Wednesday February 04, 2026 @08:51AM (#46885785)
If I found a folder with a hundred images of naked kids on your PC, I would report you to authorities, regardless of what pose kids are depicted in. So I guess the answer is no.
Re:Paris prosecutors raid France offices of Elon Musk's X by master-lincoln on Wednesday February 04, 2026 @10:35AM (#46887099)
In US law it seems the definition of CSAM does not include naked minors that do not show sexually explicit conduct: https://www.justice.gov/d9/2023-06/child_sexual_abuse_materi...
Re:Paris prosecutors raid France offices of Elon Musk's X by mnewme on Wednesday February 04, 2026 @04:58AM (#46883811)
What the hell?

As a father there shouldn’t be any CSAM content anywhere.

And think about that it is already proven these models apparently had CSAM content in their training data.

Also what about the nudes of actual people? That is invasion of privacy

I am shocked that we are even discussing this.

Re:Paris prosecutors raid France offices of Elon Musk's X by pjc50 on Wednesday February 04, 2026 @05:42AM (#46884147)
> How about "R-Rated" violence like we see in popular movies?

Movie ratings are a good example of a system for restricting who sees unacceptable content, yes.

Re:Paris prosecutors raid France offices of Elon Musk's X by ascagnel_ on Wednesday February 04, 2026 @07:57AM (#46885289)
More to the point, now that most productions are using intimacy coordinators, there's a degree of certainty around the consent of R-rated images.

There's basically no consent with what Grok is doing.

Re:Paris prosecutors raid France offices of Elon Musk's X by guerrilla on Wednesday February 04, 2026 @09:37AM (#46886327)
> There's basically no consent with what Grok is doing.

Wait how do you get consent from people that don't exist?

Re:Paris prosecutors raid France offices of Elon Musk's X by mnewme on Wednesday February 04, 2026 @03:56PM (#46891650)
AI fake nudes were made from very real and very alive people
Re:Paris prosecutors raid France offices of Elon Musk's X by guerrilla on Wednesday February 04, 2026 @05:03PM (#46892464)
This part of the thread wasn't about that.
Re:Paris prosecutors raid France offices of Elon Musk's X by exodust on Wednesday February 04, 2026 @10:07PM (#46895151)
AI generated dancing puppies were not made from real dancing puppies.
Re:Paris prosecutors raid France offices of Elon Musk's X by thrance on Wednesday February 04, 2026 @06:53AM (#46884751)
Ok, imagine your mom, sister or daughter is using X. Some random guy with an anime profile picture and a neonazi bio comes in, asks grok to make a picture of them in bikini for the whole world to see, and the bot obliges. Do you see the issue now? Because that happened to literally millions of people last month.
Re:Paris prosecutors raid France offices of Elon Musk's X by master-lincoln on Wednesday February 04, 2026 @07:28AM (#46885044)
A generated picture of a family member in a bikini is an issue?

I don't see it...

Re:Paris prosecutors raid France offices of Elon Musk's X by mnewme on Wednesday February 04, 2026 @07:34AM (#46885082)
Because you are apparently a man and have never been harassed in your life
Re:Paris prosecutors raid France offices of Elon Musk's X by master-lincoln on Wednesday February 04, 2026 @07:38AM (#46885127)
I have been harassed. Women in bikinis are normal where I live.
Re:Paris prosecutors raid France offices of Elon Musk's X by mnewme on Wednesday February 04, 2026 @07:48AM (#46885217)
There is a difference between running around in a bikini and people creating sexy pictures of yourself without consent.

You do understand that?

Re:Paris prosecutors raid France offices of Elon Musk's X by master-lincoln on Wednesday February 04, 2026 @09:20AM (#46886119)
I do understand that, but in this thread there was no mention of anything sexy so far. I am just pedantic because I think it is important when it comes to criminal accusations. Sexuality and nakedness are two different things.
Re:Paris prosecutors raid France offices of Elon Musk's X by mnewme on Wednesday February 04, 2026 @09:36AM (#46886305)
Then check what the discussion is about, this is not about some funny ai pics
Re:Paris prosecutors raid France offices of Elon Musk's X by master-lincoln on Wednesday February 04, 2026 @09:44AM (#46886410)
It started with CSAM but then derailed into people in bikinis ¯\_(ツ)_/¯

We already have laws against distributing CSAM. Let's jail the X CEO then

Re:Paris prosecutors raid France offices of Elon Musk's X by mnewme on Wednesday February 04, 2026 @11:24AM (#46887807)
I think you are trolling here.

First you defend CSAM, then we were talking about sexualised images of people without their consent, you were trying to diminish this as „just bikini“ pics

Re:Paris prosecutors raid France offices of Elon Musk's X by b40d-48b2-979e on Wednesday February 04, 2026 @08:00AM (#46885314)
People like you are why women choose the bear.
Re:Paris prosecutors raid France offices of Elon Musk's X by thrance on Wednesday February 04, 2026 @10:28AM (#46887009)
Generated by a stranger, then posted online on X for the whole world to see. Are you really OK with that, even if the subject was your 10 years old daughter?
Re:Paris prosecutors raid France offices of Elon Musk's X by master-lincoln on Wednesday February 04, 2026 @10:59AM (#46887432)
We have privacy laws forbidding anyone to share most pictures of people without their consent independent of what they are wearing on that picture. This is not new. That stranger should be investigated. I don't see why it needs to be CSAM for us to be upset about it.
Re:Paris prosecutors raid France offices of Elon Musk's X by thrance on Wednesday February 04, 2026 @11:53AM (#46888223)
Yes, and these laws are getting blatantly broken, while neither X nor the US Government are willing to do anything about it. Which is why French authorities have decided to take the matter in their own hands.
Re:Paris prosecutors raid France offices of Elon Musk's X by mnewme on Wednesday February 04, 2026 @07:25AM (#46885010)
Exactly! This should not be ok
Re:Paris prosecutors raid France offices of Elon Musk's X by SecretDreams on Wednesday February 04, 2026 @09:32AM (#46886250)
Is this post low-key advocating for anime csam in the name of freedom?
Re:Paris prosecutors raid France offices of Elon Musk's X by exodust on Wednesday February 04, 2026 @10:30PM (#46895322)
> name of freedom

Speaking of freedom, I lost posting permission yesterday after my earlier post. Even though vile replies were insinuating vile things, my right of reply was taken away. We should never diminish the "name of freedom" as you've just done.

It should go without saying that CSAM is revolting. Who wants to see that stuff? Not me, not most people. Grok can't make that content. Maybe someone got around it temporarily. I've always thought Grok heavily censored, it refuses to analyse an image of the Statue of David because "naughty bits". The ironic and sad thing is a fig leaf gets around that restriction. So the accusation that Grok has no guardrails and can generate CSAM seems at best an anomaly or a lie.