News for hackers. Stuff that matters.
Re:Safe AI Image Generation by NegativeK on Monday October 09, 2023 @09:58AM (#37820512)
How do you deal with nonconsensual generation of images of real people in sexual acts, including children?
Re:Safe AI Image Generation by zirgs on Monday October 09, 2023 @10:11AM (#37820634)
Prosecute people who distribute this stuff?
Re:Safe AI Image Generation by ImHereToVote on Monday October 09, 2023 @10:26AM (#37820767)
We don't go through the judicial system here.
Re:Safe AI Image Generation by tekla on Monday October 09, 2023 @10:17AM (#37820692)
Thoughtcrime should not be a thing. We can make laws for distribution of AI generated material
Re:Safe AI Image Generation by loki-ai on Monday October 09, 2023 @08:52PM (#37827376)
OpenAI uploading an illegal image to your machine is more than a thoughtcrime. They become the person distributing this content, and there are already laws for that.
Re:Safe AI Image Generation by Bognar on Monday October 09, 2023 @10:06AM (#37820585)
How do you deal with the same in Photoshop?
Re:Safe AI Image Generation by tivert on Monday October 09, 2023 @10:27AM (#37820779)
>> How do you deal with nonconsensual generation of images of real people in sexual acts, including children?

> How do you deal with the same in Photoshop?

You're making a false equivalence. "AI" image generation is so much easier to do and requires so much less skill than Photoshopping something that you're really dealing with an entirely different problem.

Re:Safe AI Image Generation by shlubbert on Monday October 09, 2023 @11:13AM (#37821290)
It's sad that people seem to be consistently incapable of understanding this nuance; same with the "but humans also learn by studying existing work!" argument that always come up when discussing the ethics of training and datasets.
Re:Safe AI Image Generation by dale_glass on Monday October 09, 2023 @12:12PM (#37821885)
The difference of nuance vs Photoshop is completely unclear.

Back in 2005 or so, kuro5hin (a now gone discussion site) closed signups because somebody photoshopped the founder's wife's head onto some porn. That was 18 years ago.

True, doing it with Photoshop took a bit of skill, but it is a skill a lot of people have, for whom it would be doable in minutes. For a newbie, figuring out Stable Diffusion is probably more work than figuring out how to do it in Photoshop.

And IMO the training argument is long term a pointless waste of time.

Re:Safe AI Image Generation by tivert on Monday October 09, 2023 @12:34PM (#37822144)
> The difference of nuance vs Photoshop is completely unclear.

It's perfectly clear if you realize similar is not same.

> Back in 2005 or so, kuro5hin (a now gone discussion site) closed signups because somebody photoshopped the founder's wife's head onto some porn. That was 18 years ago.

So what? Everyone here understands that's possible. If you think that example somehow addresses the concern, you missed the point.

> True, doing it with Photoshop took a bit of skill, but it is a skill a lot of people have, for whom it would be doable in minutes.

Also, IIRC, that particular Photoshop of Rusty's wife was terrible, as in obvious.

The skill "a lot of people have" is to make bad photoshops. Generative AI has the ability to near-effortlessly make ones that most people could confuse for a real photo.

> For a newbie, figuring out Stable Diffusion is probably more work than figuring out how to do it in Photoshop.

And how long will that last? You do realize someone's going to come up with an easy-to-run "revengeporn.exe" sooner rather than later?

Re:Safe AI Image Generation by stale2002 on Monday October 09, 2023 @12:55PM (#37822439)
> Again, what quality can a newbie achieve with photoshop after a couple days effort?

The answer is a better quality than if they are trying to figure out stable diffusion.

Re:Safe AI Image Generation by tivert on Monday October 09, 2023 @01:01PM (#37822533)
> The answer is a better quality than if they are trying to figure out stable diffusion.

Prove it. Give some newbie Photoshop and a week of time, and show me how well they can Photoshop the face of a particular person (say Tom Vilsack, Secretary of Agriculture) onto some porn.

Re:Safe AI Image Generation by stale2002 on Monday October 09, 2023 @01:07PM (#37822610)
> Prove it.

Literally all some kid has to do is use the Photoshop magic wand feature to copy someone's face and post it on another image.

High schoolers don't care about the difference. They'll harass the target just as much if those kinds of pictures show up around school.

And that would only take a couple minutes to produce.

High schoolers don't need a 3000$ gaming computer, and the skills of figuring out how a GitHub repo and install process works to harass their fellow students.

You are entirely confused about what the problem is here. Slight differences in technology are not the cause of the problem of sexual harassment.

Re:Safe AI Image Generation by tivert on Monday October 09, 2023 @02:43PM (#37823737)
> Literally all some kid has to do is use the Photoshop magic wand feature to copy someone's face and post it on another image.

Do it, show me the results.

> High schoolers don't care about the difference. They'll harass the target just as much if those kinds of pictures show up around school.

You're moving the goalposts. I don't care if highschoolers will run with obvious, low quality crap. In fact, throughout this whole conversation, I didn't have highschoolers harassing each other on my mind at all. I was thinking about the more general problem, which includes things like harassing exes and potential employers coming across pictures during a job search.

Re:Safe AI Image Generation by stale2002 on Monday October 09, 2023 @05:02PM (#37825442)
> I don't care if highschoolers will run with obvious, low quality crap.

> which includes things like harassing exes and potential employers

You are completely missing the point. Also, your repeated requests that I engage in sexual harassment is weird.

The damage of sexually harassing messages being sent to your friends and families can be just as damaging regardless of whatever small quality issues that you think exist.

You are confused about what the issue is. People are still significantly harmed via this harassment, even if there are quality issues. The "accuracy" isn't the determining factor here. Instead, it is the sexually harassment messages and images being spammed to people surrounding the victim.

Re:Safe AI Image Generation by agar on Monday October 09, 2023 @04:30PM (#37825112)
I've read many of your replies, and while I /think/ I understand your point, I am not sure what you're proposing.

Is this a reasonable summary?

> AI = easy, so it should be regulated. It has passed the "threshold of simplicity" (and realism) where new legislation should be enacted.

> Photoshop = harder, so it should not be legislated.

If so, what happens when Photoshop releases a "copy/paste a face" feature (a desired general photo editing capability) that uses GenAI to merge background, skin tone, lighting, etc.? That could easily be a beginner-level feature (ctrl-c/ctrl-v with auto-segmentation) and be used to create porn.

Are you proposing that the feature be regulated because it's become too easy? That artificial barriers of difficulty be implemented?

Again, what are you proposing be the outcome?

Re:Safe AI Image Generation by tivert on Monday October 09, 2023 @12:19PM (#37821963)
> It's sad that people seem to be consistently incapable of understanding this nuance...

It's a problem software engineers (or some superset that contains them) seem particularly prone to.

Re:Safe AI Image Generation by shlubbert on Monday October 09, 2023 @04:26PM (#37825063)
Something something binary thinking
Re:Safe AI Image Generation by kbelder on Monday October 09, 2023 @01:35PM (#37822972)
It's not a matter of understanding; people just disagree.
Re:Safe AI Image Generation by RcouF1uZ4gsC on Monday October 09, 2023 @11:27AM (#37821429)
> You're making a false equivalence. "AI" image generation is so much easier to do and requires so much less skill than Photoshopping something that you're really dealing with an entirely different problem.

And Photoshop is so much easier to do and requires much less skill than carving marble statues.

I say we also ban Photoshop and only allow chisels and stones.

Re:Safe AI Image Generation by tivert on Monday October 09, 2023 @12:23PM (#37822011)
> And Photoshop is so much easier to do and requires much less skill than carving marble statues.

You are frankly missing the point. The issue isn't easier, the issue is crossing a threshold of easiness or scalability that means the problems can't be managed the same way as they were in the past.

For instance: the problem of revenge porn was severely limited before cameras existed and before the internet made mass distribution effortless. Digital cameras + internet distribution removed technological limiting factors, and made the problem significantly more severe and widespread.

But there's still limiting factors that make individual-infraction level enforcement possible: the perpetrator needs some physical access to the victim such that the victim usually knows who took the photo. Generative AI even removes that limitation.

That might no mean anything should change, but it does mean "LOL. I can find similarities so they're the same," isn't a reasonable response.

Re:Safe AI Image Generation by NegativeK on Monday October 09, 2023 @10:36AM (#37820871)
I'm not asking for a for the children blob of legislation here, everyone.

But I do see mass-scale generation of nonconsensual images, well beyond individually commissioned works -- and actual CSAM blending in with it because it becomes indistinguishable -- as a real problem.

We're having nuanced discussions about how to deal with misinformation, including mass-scale generation of it from LLMs. Why can't we have those discussions about AI porn so that we can come up with solutions that are somewhere between "change nothing/don't be a prude" and "go full authoritarian"?

Re:Safe AI Image Generation by braelen7 on Monday October 09, 2023 @11:45AM (#37821625)
I mean if you want to have that discussion then how do you differentiate fictional death and murder in movies and the written word vs AI generated nudity?

To me, it seems like we quickly get into the AI image equivalent of prosecuting the actor in a movie for committing the murder of a fictional character. We even go as far to have the entire genre of horror movies at mass Hollywood scale based around fictional death and murder.

It gets even stranger with sex and nudity when such a large % of people are online porn consumers. I have seen the figure for men at 90%. It is where I think the market will actually figure out the solution and that the porn consumer will want assurance the person is real and not AI.

What is disingenuous in this debate to me is that chatGPT estimates there might be over 100 million pictures of real naked people on the internet as of 2021 lol. It is like we are pretending these pictures don't already exist of real people at a huge scale and that no one really looks at them at huge scale now. It is only when AI starts cranking them out people will be so tempted and THAT is a big problem.

If anything, this is the much bigger problem that we can no longer discern the magnitude of a problem in the real world vs the R0 of the idea of a problem online.

"Since everyone is posting about AI generated nudity/porn, it must be a big problem."

Re:Safe AI Image Generation by NegativeK on Monday October 09, 2023 @01:05PM (#37822582)
For context, I was referring to using someone's likeness or CSAM. Both of those are significantly different than fictional characters portrayed by consenting actors.
Re:Safe AI Image Generation by stavros on Monday October 09, 2023 @10:34AM (#37820860)
If someone wants to generate deepfakes of me having dinner, or sex, be my guest. What's the harm to me? It's not like I'm ashamed of having either.
Re:Safe AI Image Generation by hiatus on Monday October 09, 2023 @10:06AM (#37820591)
How do you deal with that now, when a sufficiently-skilled artist can do the same for anyone?
Re:Safe AI Image Generation by zztop44 on Monday October 09, 2023 @10:13AM (#37820647)
You don’t have deal with it very much because the barrier of finding a sufficiently skilled artist who is motivated to do so is quite high compared to the reward. If the barrier is simply typing a few words into a web app however…

Spam email and annoying door to door sales might look like similar problems, but they demand very different solutions.

Re:Safe AI Image Generation by hiatus on Monday October 09, 2023 @10:21AM (#37820721)
I knew this would be the counter. The parent said nothing about scale. We already have laws around this kind of thing, the technology used is irrelevant to the application of the law. Murder is murder whether it's with a gun or poison.
Re:Safe AI Image Generation by j16sdiz on Monday October 09, 2023 @10:34AM (#37820853)
> Murder is murder whether it's with a gun or poison.

But we have laws specifically for weapons of mass destruction, instead of just suing those who use nuclear bomb with murder

Re:Safe AI Image Generation by jedberg on Monday October 09, 2023 @11:57AM (#37821744)
But scale matters, because usually the law doesn't get involved until scale is reached. We didn't used to have anti-spam laws because it wasn't a problem at small scales.

Then it became easy for everyone and became a problem, so laws were created specifically to combat electronic spam, because current laws didn't cover that situation.

Re:Safe AI Image Generation by lancesells on Monday October 09, 2023 @10:34AM (#37820854)
Money, effort, morals.
Re:Safe AI Image Generation by mnd999 on Monday October 09, 2023 @10:06AM (#37820587)
You decide everything is either good or bad with no shades of grey, declare yourself a free speech absolutist and tell everyone that however bad that is, censorship is worse.
Re:Safe AI Image Generation by echelon on Monday October 09, 2023 @10:14AM (#37820658)
We already have the laws we want, more or less. It's just that the barriers to creation have been lowered.

If we encumber the tech with regulation, only the giants will be able to engineer the adequate protections that fit the letter of the law. You'll effectively be choosing the winners and creating a massive barrier to entry for everyone else.

Re:Safe AI Image Generation by raxxorraxor on Tuesday October 10, 2023 @07:20AM (#37830716)
Free speech absolutists, an absurd insult for that matter, usually have the exact opposite position and leave the question of morality open.
Re:Safe AI Image Generation by echelon on Monday October 09, 2023 @10:11AM (#37820630)
Exactly how we deal with it now. Laws against the specific undesired behavior.

Burdening these systems early on with legislated regulations only makes it so that the incumbents win. Regulations are a moat.

Re:Safe AI Image Generation by raxxorraxor on Tuesday October 10, 2023 @07:17AM (#37830692)
Luckily for image generation they did not win. Different situation for LLMs though. You are correct that it would only entrench positions.

I am angry at EU legislation. While it was heavily involved in research, legislation are again on the course to fortify dominance of established big tech players. Probably because their interests often align with media interests, which have a huge influence on EU politics. And I do not mean the open and independent part of media, rather the established players that have direct business relations with huge tech firms.

Re:Safe AI Image Generation by causi on Monday October 09, 2023 @10:15AM (#37820666)
The same way you deal with people photoshopping real faces onto nude bodies.
Re:Safe AI Image Generation by charcircuit on Monday October 09, 2023 @11:08AM (#37821239)
Rule 34 of the Internet. Trying to stop it is futile.
Re:Safe AI Image Generation by redox99 on Monday October 09, 2023 @11:43AM (#37821602)
I wouldn't mind having my face deepfaked into a porn or whatever as long as there was a small watermark or something that indicated it was fake.

I think enforcement should be focused on disclosing what's AI generated/fake, not on banning altogether.