News for hackers. Stuff that matters.
Re:Tainting the CSAM client-side scanning database by sneak on Friday October 13, 2023 @11:36AM (#37871788)
> Possession of CSAM should be illegal regardless of whether it's "real" or not.

From a purely ethical standpoint: why? What is the purpose of punishing someone who has harmed no one?

No victim means no crime.

Re:Tainting the CSAM client-side scanning database by chatmasta on Friday October 13, 2023 @11:47AM (#37871910)
From a purely ethical standpoint, sure, I agree. But we live in reality, and there are plenty of activities that seem ethically victimless, but are practically necessary to criminalize, in order to uphold societal frameworks and expectations of morality.

In this case, by giving every CSAM criminal a potential excuse that they "thought it was AI generated," the real victims are further victimized by being deprived of justice or forced to prove their realness.

Re:Tainting the CSAM client-side scanning database by dragonwriter on Friday October 13, 2023 @11:54AM (#37871997)
Broadening the definitions of crime to make it easier to punish the ethically guilty on scant evidence while incidentally sweeping up the ethically innocent is a hack around a legal tradition that is designed exactly on the principal that it is better that the guilty go unpunished than the innocent are punished, by making the genuinely innocent administratively guilty, and we ought to reject that kind of justification every time it rears its head.

(There are times when it is important to have commonality while the choice of the common practice isn't important, which justifies regulations of obviously ethically unimportant things like "which side of the road is it correct to drive on relative to the direction of travel"; but where the purpose of a crime is purely to lower the evidentiary bar to punish people presumed guilty of a narrower crime, that's just an attempt to hack around the presumption of innocence and the burden of proof of guilt.)

Re:Tainting the CSAM client-side scanning database by saalweachter on Friday October 13, 2023 @12:30PM (#37872405)
Broadening the definition of a crime isn't exactly unheard of.

To choose a less emotional subject, mattress tags.

The reason for a mattress tags is because historically people would sell mattresses stuffed full of all sorts of unsavory garbage. What we actually criminalized, or at least were trying to prevent, was some sort of fraud or public endangerment.

But we also along the way made it illegal for sellers to remove the tags from mattresses.

Removing the tag isn't inherently harmful; if you don't deceive the purchaser on the contents of the mattress, it's not even fraud.

But we broadened the definition of the crime to make it easier to enforce.

Re:Tainting the CSAM client-side scanning database by novok on Friday October 13, 2023 @04:37PM (#37875351)
You are going into forced labelling disclosure, which can have a lot of benefits beyond fraud prevention because it increases informed consent and all sorts of other net goods. It's the logic and ethics of nutrition labels, and IMO is probably one of the more good vs bad things that govts can mandate.
Re:Tainting the CSAM client-side scanning database by chatmasta on Friday October 13, 2023 @12:11PM (#37872172)
I agree with you. I think our disagreement here is over the level of innocence of someone possessing AI generated CSAM.

If you believe, as I do, that such a person is guilty of a crime, then we're not risking the false guiltiness of an innocent person. At best, we're risking their level of sentencing. And I'm open to the idea of reduced sentences for AI CSAM, but it shouldn't be a factor in determination of guilt (i.e. it should be a matter between the judge and the defendant, rather than something the prosecution needs to prove).

With regards to CSAM criminalization in general, there is a real risk of punishing innocent people that may have been framed by planted evidence. But this is a risk regardless of whether the evidence is "real" CSAM or not, so legalizing possession of AI-generated CSAM doesn't reduce the risk of an innocent person being framed. It might make it "easier" for a bad actor to frame someone, since they can now do it with AI content instead of real content. But if they're already planting evidence, do they really care whether they're committing a crime while preparing the evidence? And besides, if we keep the AI content illegal, then it's equally legally risky to frame someone with it as it is to frame them with real content.

The problem of prosecuting "innocent" people, whether you believe they're innocent because they were framed or because they're only guilty of possessing AI-generated CSAM, should be addressed at the time of enforcement. Stop using entrapment and fishing expeditions as an enforcement mechanism. Only open investigations when they start with a real and identifiable victim, rather than a potential perpetrator.

Re:Tainting the CSAM client-side scanning database by dragonwriter on Friday October 13, 2023 @12:16PM (#37872220)
> I think our disagreement here is over the level of innocence of someone possessing AI generated CSAM.

> If you believe, as I do, that such a person is guilty of a crime,

You just explicitly said upthread that ethically they are not, but argued that it is useful for them to be treated as criminals because it denies an excuse to those who are ethically guilty because they are possessors of genuine CSAM.

You seem to be moving your fundamental ethical premises around in response to it being pointed out that the argument you previously made conflicts with a different widely proclaimed ethical premise.

Re:Tainting the CSAM client-side scanning database by chatmasta on Friday October 13, 2023 @12:23PM (#37872302)
My ethical premise is that there is no direct victim of AI generated CSAM, but that it's worth criminalizing because otherwise it further victimizes victims of existing law. In other words, there is a societal victim of it. To me it's the same ethical premise but interpreted within two different frameworks: one that's purely idealistic, and one that's based in practical reality.
Re:Tainting the CSAM client-side scanning database by sneak on Friday October 13, 2023 @12:43PM (#37872569)
AI cannot generate CSAM, because AI cannot abuse children. AI makes fictional images, which definitionally cannot be images of child sexual abuse.

There is literally no victim of any kind, even conceptually, in the case of computer generated imagery. It should be protected artistic expression.

Re:Tainting the CSAM client-side scanning database by chatmasta on Friday October 13, 2023 @12:48PM (#37872642)
What if a police officer generates some AI CSAM and then sells it to someone who thinks it's real? There's still "no victim," but the buyer thinks that there was. Are they guilty of a crime?

Your logic would seem to imply that there's no crime with possession of real CSAM either, and that the only crime lies with the original abuser who took the pictures.

Re:Tainting the CSAM client-side scanning database by giantrobot on Friday October 13, 2023 @01:53PM (#37873457)
> Are they guilty of a crime?

Unless there is a very specific "attempt to acquire CSAM" law then no they're not fucking guilty of any crime. If you live in a state where marijuana is illegal and you smoke some oregano because you thought it was marijuana you're not guilty of actually possessing marijuana.

A criminal law is composed of a number of individual statutes. When a state is trying to prosecute someone for a crime they need to prove three elements for each statute: the criminal act (actus reus), intent (mens rea), and the concurrence of both of those.

If a cop sells you oregano and you think it's marijuana you might have the intent to buy marijuana but there's no actual criminal act because oregano isn't illegal. If you make a law that only requires intent then congratulations, you've created thought crimes.

If you want to make entirely fake CSAM possession illegal, that's essentially the same as an intent-only law and creates thought crimes. It's a slippery slope.

Re:Tainting the CSAM client-side scanning database by Genghis_Khan on Friday October 13, 2023 @03:56PM (#37874866)
> If a cop sells you oregano and you think it's marijuana [...]

It wasn't a cop, but I recall a case some years back when someone sold something as cocaine when it wasn't. Among other things, he went down for fraud.

Re:Tainting the CSAM client-side scanning database by trehalose on Friday October 13, 2023 @04:08PM (#37874995)
> If a cop sells you oregano and you think it's marijuana you might have the intent to buy marijuana but there's no actual criminal act because oregano isn't illegal. If you make a law that only requires intent then congratulations, you've created thought crimes.

You're a lawyer, I take it? I'm not a lawyer, and I admit your analysis of this scenario confuses me. Is there no legal difference between merely having intent to commit a crime at some point in the future, and actually attempting to commit a crime?

Re:Tainting the CSAM client-side scanning database by trifurcate on Friday October 13, 2023 @05:48PM (#37875984)
Definitely not a lawyer. You couldn't charge anyone with criminal conspiracy from the parent commenter's perspective.
Re:Tainting the CSAM client-side scanning database by giantrobot on Friday October 13, 2023 @07:47PM (#37876812)
I'm definitely not a lawyer.

> Is there no legal difference between merely having intent to commit a crime at some point in the future, and actually attempting to commit a crime?

That was my point. To be charged with and prosecuted for a crime you need to both intend to commit it and then actually/attempt to commit it. Attempted murder is a crime, I both intend to kill someone and try to do so even if I fail. It's not punished as severely as actual murder but it's still a crime. But attempted murder is actual a specific crime in the criminal code. There's elements of it that need to be proven in court.

Unless a jurisdiction has a crime of "attempted possession of marijuana", intending to buy marijuana but ending up with oregano isn't a crime someone can be charged with. If we start writing laws outlawing attempted possession it's a slippery slope that gets into outlawing thoughts. It also opens the door to stupid pre-crime ideas like someone would only use cryptography to get ahold of illegal content therefore anyone using cryptography is instantly guilty of attempting to get illegal material.

You can be sure this is what will happen because it's the very arguments the anti-cryptography groups use.

Re:Tainting the CSAM client-side scanning database by qingcharles on Thursday October 19, 2023 @06:16PM (#37949502)
Attempted possession of an illegal item/substance is absolutely a crime.

Source: decade in the criminal justice system.

Re:Tainting the CSAM client-side scanning database by LorenPechtel on Friday October 13, 2023 @06:37PM (#37876370)
While in one way you could look at it and say possession shouldn't be illegal the problem is that to possess it someone must have created it. If there's a market in it some people will engage in it to satisfy that market. Thus, possession of real CSAM has an indirect victim.

I had previously proposed that if the abuser has been caught that the victim should get the rights to the images and once they are an adult be allowed to legally sell them (thus a list of legally permitted images), but the AI image revolution has changed that. Have AIs sign their images, CSAM with a proper signature is legal.

Re:Tainting the CSAM client-side scanning database by qingcharles on Friday October 13, 2023 @12:21PM (#37872283)
There are plenty of "victimless" crimes that society deems unsavory and punishes. e.g. smoking pot in your home, alone is a crime in a lot of jurisdictions, even though clearly no-one is harmed.

In a lot of jurisdictions the decision has been made, whether it is right or wrong, to criminalize AI CSAM. The people have spoken and the lawmakers have made the laws. If you or I think that is wrong then the options are to lobby for a change.

Re:Tainting the CSAM client-side scanning database by dragonwriter on Friday October 13, 2023 @12:28PM (#37872367)
> There are plenty of "victimless" crimes that society deems unsavory and punishes.

That is not an argument against the concept that that should not be the case.

Re:Tainting the CSAM client-side scanning database by adrr on Friday October 13, 2023 @01:42PM (#37873342)
Plenty of actions are crimes without real victims. Not having insurance while driving is an example. Possession of explosives is another one.
Re:Tainting the CSAM client-side scanning database by chatmasta on Friday October 13, 2023 @01:52PM (#37873440)
In fact, you might even argue that possessing real CSAM has no victim. After all, the person possessing the image isn't the one who committed the abuse and took a picture of it, right? But we've collectively decided that it's worth punishing that crime, because every viewer is an enabler of the abuser. The same logic should extend to AI-generated content.

To put it another way, consider a thought experiment where a police officer generates CSAM with AI and then sells it to someone who thinks it's a real picture of a real victim. We should arrest the buyer, right? They thought they were committing a crime.

Re:Tainting the CSAM client-side scanning database by Eisenstein on Friday October 13, 2023 @03:58PM (#37874887)
You have literally proposed 'thought crimes'.
Re:Tainting the CSAM client-side scanning database by chatmasta on Friday October 13, 2023 @08:39PM (#37877086)
There's plenty of precedent where police officers pretend to be an underage person and some shmuck replies to them and agrees to meet at a hotel. Then they get arrested, and much of the time they also get prosecuted and convicted. You could argue it's entrapment but the fact is that most of society supports that sort of preemptive law enforcement.

If you looked at it through a purely ethical framework then you could never convict the person because there was never any "real victim." But is that the right way to look at it? It's certainly not the way most people look at it.