News for hackers. Stuff that matters.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by hexage1814 on Saturday May 18, 2024 @05:58AM (#40397702)
Somewhat controversial but honestly, if someone will consume this sort of material, I rather it is deepfake than the real thing. I think it's pretty authoritarian for the state to outlaw – and jail to 14 years in prison someone – because he rendered the “wrong arrangement of pixels ” on his computer. The whole way society deals with problem, regarding the consumption of this material, there's a lot moral panic going on and folks using this to increase government overreach.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by Mordisquitos on Saturday May 18, 2024 @06:33AM (#40397839)
I was about to comment that use of the newish term "CSAM" over the old fashioned "CP" seemed out of place here, given that the argument to prefer "Child Sexual Abuse Material" over "Child Porn" is to emphasise the sexual abuse of a child that took place to create it. So, at first glance, my immediate thought was that deepfakes would more accurately be described as child pornography than child sexual abuse material by their very nature.

However, it isn't clear to me from the press release which was the origin of the "nude bodies and bodies engaged in sex acts" on which the condemned man superimposed the faces of child celebrities. Were those bodies from consenting adults, or were they from non-celebrity children?

If it's the first case I would argue that the images possessed by this man were CP, not CSAM, and you may have a good point to raise a debate. If on the other hand the original body images were indeed from children then this instance can accurately be described as CSAM (but I'm an old fogey and will continue to call it CP) and it wouldn't be a case of government overreach — the fact that the man used deepfakes to replace the faces of the children being exploited is a mere curiosity.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by throwaway290 on Saturday May 18, 2024 @07:46AM (#40398195)
> use of the newish term "CSAM" over the old fashioned "CP" seemed out of place here

Training data though.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by jorvi on Saturday May 18, 2024 @06:57AM (#40397934)
I think a secondary question is: how is this illegal but someone doing the same with a children’s fashion magazine, a Playboy and some glue isn’t?

Which is a wider question for deepfakes in general: how is it possible that I can grab a pencil and legally draw, say, Halle Berry in some sort of pornographic pose, but if I do the same via deep learning, it’s suddenly illegal.

It doesn’t make sense, and makes me feel like the arguments behind it are on very shaky legal ground.

Note that this is separate from sharing these images, where the real harm happens.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by gizmo686 on Saturday May 18, 2024 @07:09AM (#40397997)
The legislative and executive branches have always wanted that type of drawn child porn to be illegal. Going by the laws on the books, it still is.

The only reason it is not illegal is the supreme court ruling such laws unconstitutional under the first amendment.

Deepfakes are sufficiently novel, that the old precedent does not completely apply, so the executive is free to enforce the law until the appeals courts start ruling to the contrary.

And with the current make up of the Supreme Court, I'm not sure which was the constitution will end up going on this issue.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by rustcleaner on Saturday May 18, 2024 @07:54AM (#40398230)
There are men sitting decades in the US for drawings.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by ChrisMarshallNY on Saturday May 18, 2024 @07:25AM (#40398077)
One of the problems with this kind of thing, in general, is that it tends to escalate.

We may start off, reading raunchy comics, but the need for "more" grows, until we find that only The Real Thing will suffice.

This doesn't happen to everyone, but it happens to enough folks, that it can be a serious problem (and also, serious money. Pr0n companies bank on getting folks to go deeper into the rabbithole).

I should add that, in the US, sexual offense convictions are really a life sentence. Offenders need to register as sex offenders on public databases, for the rest of their lives, and, quite often, are not allowed to live near schools.

I know that in one city, there was a bridge that a whole bunch of sex offenders lived under, because there was nowhere else they could rent apartments.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by bawolff on Saturday May 18, 2024 @07:33AM (#40398122)
It seems like there are two conflicting theories:

Either A - its a gateway to worse behaviour. Thus criminalizing this prevents future victims.

Or B - its gives pedophiles a release not involving real people, thus preventing victimization of real people that would have otherwise happened.

What laws we should make as a society depends on which of these opposite theories are true. Is there any actual research on this? Surely psychologists must have studied this.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by mc32 on Saturday May 18, 2024 @07:42AM (#40398170)
There’s also the possibility that both are true.

Some people stop at weed, but some people go on and get hooked on bad drugs.

Maybe, some day, they’ll develop an unaddiction drug as well as an unpervert drug or treatment.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by roenxi on Saturday May 18, 2024 @07:53AM (#40398225)
I agree that they are both probably true, but I don't think that fully addresses bawolff's point which I would interpret as harm reduction. If, on net, the B class dominates the other by a big margin then the net harm would be reduced and laws shouldn't be harsh - even if the A scenario plays out sometimes. The law should try to figure out who is actually causing abuse to happen and then target them.

My bet is it would be a net reduction because if you hit someone with dopamine when they are staring at a screen they spend more time staring at screens (I'm pretty sure we found that was how violent video games work out, most gamers are a bit more of the weedy and harmless style in real life). But some stats would be helpful.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by mc32 on Saturday May 18, 2024 @08:09AM (#40398327)
There is the possibility as in weed legalization that now you get more users who would otherwise avoid it. An increased user base means additional users going for the hard stuff.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by roenxi on Saturday May 18, 2024 @08:59AM (#40398658)
Yeah, but that is sort of on the path of assuming there are latent paedophiles out there which just seems a stretch. Everyone encounters children, usually quite regularly. Most people have their own, in fact. If they have an attraction to them that is so strong they're going to go off the rails they've probably had it triggered.

The paedophiles already know who they are. It is quite plausible that the number of additional offenders from easy access to pornography would just be a reduction with negligible other effects. The stats don't suggest traditional pornography availability has led to more sex - quite the reverse, in fact, based on my cursory readings.

But, as every comment in the thread points out, there really needs to be some effort put in to figuring out what would happen if it hasn't already been done. I'm not sure if you're looking for something here, we all agree there are multiple ways any change could play out.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by fiso64 on Saturday May 18, 2024 @08:51AM (#40398598)
>Is there any actual research on this? Surely psychologists must have studied this.

That's not an easy thing to study, not many pedophiles would be willing to participate in studies. Existing research mostly examines just the ones who have offended. There's some research about non-contact offenders though: https://sci-hub.se/https://journals.sagepub.com/doi/abs/10.1...

TLDR

> while some have argued that exposure to child pornography may promote contact sexual offending by validating and reinforcing attitudes surrounding the sexualization of children (Bourke & Hernandez, 2009), others have argued that child pornography acts as a substitute for contact offending, thereby preventing the direct sexual victimization of children (Riegel, 2004). Although plausible, such causative positions are yet to be directly examined or established within the existing empirical literature base, limiting the strength of these arguments.

> Nonetheless, the available evidence does not appear to support the idea of a direct causal relationship between child pornography and contact sexual offending, at least in the short-term. This is consistent with the findings of McCarthy (2010), who reported that the majority of dual offenders in her sample (84%) had committed contact sexual offenses prior to, rather than following, their involvement with child pornography. Furthermore, if child pornography directly promoted contact sexual offending, one would reasonably expect rates of contact sexual offending to have similarly increased over the last two decades (Glasgow, 2010). Fortunately, official crime statistics indicate that this has not been the case (Brennan, 2012; Motivans & Kyckelhahn, 2007; Victoria Police, 2014).

> Taken together, these findings suggest that although some CPOs do go on to commit sexual offenses against children, engaging in child pornography offending does not inevitably lead to the direct sexual victimization of children.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by Sargos on Saturday May 18, 2024 @08:53AM (#40398615)
This is the same argument they used in the 90s to ban Mortal Kombat and other violent games. It wasn't a good argument then and it isn't a good argument today.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by ChrisMarshallNY on Saturday May 18, 2024 @09:49AM (#40399060)
I don’t remember what the fallacy is called, but there’s one, where folks take something that belongs to one instance, and apply it to another instance, where the veracity is tenuous.

An example is Marie Nyswander’s “broken brain” theory, that she invented, to push methadone. It’s never even come close to being proven, but sounds downright sensible; especially when someone wearing a lab coat spouts it. It’s the one, where they tell you that your brain is “broken,” because of drug use, and can no longer produce endorphins (or other brain chemicals -it can vary). There is a significant element of shame involved, telling the user that it’s “their fault” that their “brain is broken,” but they are in luck, because this pill will fix it.

It was pretty much B. S., anyway, even for opiate drug use, but I have also seen it applied to alcoholism, pot smoking, kleptomania, sexual compulsion, gambling, anorexia, cults, video games, violent behavior, and habitual criminal behavior.

It’s one of those theories that makes sense, if you don’t sweat the details, but has never actually been proven, by anyone reputable.

Lot of CBD snake oil uses similar stuff.

Like I said, the progression only actually seems to happen to a fairly small number of people. The crimes they commit, though, are pretty bad. A risk management approach needs to score both impact and probability. People tend to get caught up in only one axis; usually the one that supports their preconceptions.

I have an acquaintance that is a passionate pool safety advocate. That’s because she had a nephew die in a pool. If you talk to her, pool safety is the #1 national priority, and all other issues are secondary.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by michaelmarkell on Saturday May 18, 2024 @06:08AM (#40397742)
From the article it seems like the content wasn’t entirely AI generated, it “digitally superimposed the faces of child actors onto nude bodies”, which makes this a lot worse than purely AI generated content
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by Retric on Saturday May 18, 2024 @06:24AM (#40397807)
Why specifically? The child actors aren’t harmed, nor is anyone else as far as I can see. So what exactly makes this worse than say AI art or a painting?
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by spuz on Saturday May 18, 2024 @06:44AM (#40397881)
It's not explicitly stated, but also isn't ruled out that the nude bodies they were real photos of real children in which case, the deepfake element would be irrelevant.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by Retric on Saturday May 18, 2024 @06:58AM (#40397939)
Sure, that’s a reasonable reaction assuming it applies. But people seem to have a strong reaction even if it didn’t, which is more what I was trying to understand.

I could see using adult models for source material as a sign of mental illness and proactively institutionalizing someone for that is on the table, but prison IMO implies some kind of harm.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by ben_w on Saturday May 18, 2024 @07:31AM (#40398107)
> But people seem to have a strong reaction even if it didn’t, which is more what I was trying to understand.

There's some images and concepts where humans generally have a strong disgust reflex; I'm not sure how much any of these various reflexes are innate vs. learned, but in either case overcoming them is likely to also have severe negative consequences.

One of the common tropes I've seen in every debate about human sexual desires and what should be forbidden, there's always someone who treats it as a slippery slope. I don't think they've been right, but I can see the possibilities for how they might be.

But we may have to be, despite those possibilities.

Unfortunately, given how easy it now is to fake such material and how this is absolutely going to impact elections going forwards because people are going to use the tech to create fake images of politicians.

20-odd years ago I saw a Photoshopped picture where someone had put the faces of George W. Bush and Osama bin Laden onto a gay porn photo, I think it was to protest the American invasion of Afghanistan; more recently, we've already had a newsworthy generated image of Trump resisting arrest, and I'd be shocked if nobody's yet put him into an image with Stormy Daniels.

There's a possibly apocryphal but widely believed quote from Trump, "If Ivanka weren't my daughter, perhaps I'd be dating her", and at the (supposed) time of the quote Ivanka was 13 — and remember, this is believed because, to a first approximation, someone put some text on a photo and tweeted it — someone is almost certainly going to use AI to generate that scene.

As Trump has (despite the legal battles which needed a much higher standard for their evidence even to get started) a reasonable chance of winning the next election, there's a real chance of people seeing that generated image, taking it seriously, and repeating the Jan 6 2020 attempt to prevent the transfer of power. Only this time, without needing a charismatic leader to lead them.

And because that Ivanka quote isn't well-evidenced yet is widely believed, that's also a problem that almost every democracy will have to face forever, no matter what you think of Trump himself.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by zimpenfish on Saturday May 18, 2024 @07:41AM (#40398162)
> There's a possibly apocryphal but widely believed quote from Trump, "If Ivanka weren't my daughter, perhaps I'd be dating her"

Not even slightly apocryphal. You can see the clip on YouTube, e.g. [1] But she was 25 at the time, not 13.

« When Trump was the star of the reality TV show “The Apprentice,” he appeared on the ABC talk show “The View” with his daughter in 2006 and said, “If Ivanka weren’t my daughter, perhaps I’d be dating her. Isn’t that terrible? How terrible? Is that terrible?” »

> And because that Ivanka quote isn't well-evidenced

I would dispute that.

[1] https://www.youtube.com/watch?v=diMp241gAcw

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by ben_w on Saturday May 18, 2024 @07:47AM (#40398200)
The claim that is disputable is specifically that he said it when she was 13, not that he also said it when she was 25.

Half-truths have always been a fantastic method for propaganda.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by Dylan16807 on Saturday May 18, 2024 @05:53PM (#40402433)
I've never heard that subclaim before despite the quote coming up many times so maybe it's not as widespread as you think.

And you specifically said the quote was "believed".

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by zimpenfish on Sunday May 19, 2024 @01:13AM (#40404430)
I've heard a different quote that was allegedly made when she was 13 (I guess taking an proven quote and transposing the age to another unproven quote is an easy step, possibly even accidentally) but Snopes currently rates that as "unproven".

(Given the things he's actually on record as saying, it wouldn't surprise me though.)

https://www.snopes.com/fact-check/trump-sexually-attracted-i...

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by basil-rash on Saturday May 18, 2024 @06:43AM (#40397877)
The face actors weren’t harmed, the body actors (unidentifiable, but in all likelyhood youth) were.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by throwaway11460 on Saturday May 18, 2024 @08:01AM (#40398270)
How do you know it's not bodies of willing adult pornographic actors that merely appear child-like?

Why would you swap faces when you already had the pictures, if not to hide the adult facial features?

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by basil-rash on Saturday May 18, 2024 @09:59AM (#40399147)
By that argument, deep fake porn shouldn’t exist at all. But it does, so clearly that’s not the way these people see the world. Some faces are simply “better” than others, at least in so far as those with perverted pornographic desires are concerned.

Regardless, child faces in adult bodies is in fact still illegal, see this detailed court report for more info: https://casetext.com/case/united-states-v-smelko-2

To amend my prior comment, the law says that the face actors in fact are harmed as well, reputationally. Fair enough; I’m not here to play “defend the pedo”.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by throwaway11460 on Saturday May 18, 2024 @10:12AM (#40399225)
It exists because face is what gets visibly aged on people even if the body isn't easily distinguishable from children. Why is it called "child sexual abuse material" if no child was abused in its creation?

Ad reputational damage - OK, I agree if they distribute it, that's fair. But if they don't distribute and the police finds it only after they take their hard drives?

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by nurettin on Saturday May 18, 2024 @06:46AM (#40397887)
It was trained on macabre images. So there is real CP involved.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by chalcolithic on Saturday May 18, 2024 @07:33AM (#40398116)
Not to mention that a good quality deep fakes (once legalized) will completely destroy any economic incentive for real CP production.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by llamaimperative on Saturday May 18, 2024 @07:35AM (#40398130)
We don’t know that. There’s a perfectly sane argument that it’ll amplify it by increasing availability and allowing more people to “dip their toes” so to speak.

I think this is something researchers should try to figure out rather urgently. If it can destroy incentives then great, if it amplifies then, obviously, not great.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by friend_and_foe on Saturday May 18, 2024 @05:24PM (#40402239)
If people can "dip their toes" into something and then develop a proclivity towards it, doesn't that imply sexuality is not innate? If it is innate then this is not a concern, and if it is not innate, the prevailing views we have on this topic are going to challenge that conclusion.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by llamaimperative on Saturday May 18, 2024 @05:59PM (#40402473)
You're wondering whether preferences and tastes can develop or shift over time and with exposure? Obviously they can and do.

Presumably you’re pointing to “ahh so we CAN pray the gay away!” or whatever other ridiculous intervention you can imagine. The pushback on this mode of thinking has little to do with whether people’s preferences can hypothetically change and more to do with 1) who the fuck cares outside of theological arguments which have no standing in developed legal systems, and 2) the “interventions” are generally barbaric and across the board not shown to be effective.

Obviously people who want to voluntarily attempt these interventions are more than welcome to (and do). But that’s never what the conversation is about.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by throwaway290 on Saturday May 18, 2024 @10:50PM (#40403823)
> preferences and tastes can develop or shift over time and with exposure

You'd be surprised how many progressive(?) people would balk and call you out if you suggest that...

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by llamaimperative on Sunday May 19, 2024 @06:51AM (#40405951)
Nope, as explained they’re balking at the social and political implications of someone who is hostile to LGBT existence suggesting that.

Justifiably, given that historically people trying to “enact” this belief through political and social means have reliably resorted to incredibly awful (and again, ineffective) “interventions.”

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by throwaway290 on Sunday May 19, 2024 @07:44AM (#40406263)
Many (not all, not the most) perceive the notion as a threat because it goes against the belief that it is a fixed quality
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by friend_and_foe on Sunday May 19, 2024 @01:46AM (#40404521)
I said nothing about praying.

It is commonly accepted in our time that you're born with your sexual proclivities, and it is a sensitive topic, saying otherwise can get you into serious social trouble. So, the idea that "preferences and tastes" as you put it with regard to sexual orientation can change is widely a taboo in modern western society. To me, this directly conflicts with the concept that someone can develop a sexual attraction via exposure to pornography; the two beliefs are mutually exclusive. I'm just pointing out the difficult social consequences of investigating and confirming whether exposure can alter someone's attractions in that way.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by llamaimperative on Sunday May 19, 2024 @06:48AM (#40405941)
> I’m just pointing out the difficult social consequences of investigating and confirming whether exposure can alter someone’s attractions in that way

Not true. You’re mistaking that for “the difficult social consequences of forcing other people to be studied to confirm whether exposure can alter someone’s attraction that way.”

You’re more than welcome to conduct such experiments on yourself. And sure, some people might disagree with it, but some people will disagree with anything someone does.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by bongodongobob on Saturday May 18, 2024 @07:37AM (#40398140)
People still buy real diamonds.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by throwaway11460 on Saturday May 18, 2024 @07:58AM (#40398250)
Do you expect a huge marketing campaign from BigCSAM focused on convincing pedophiles that only real CSAM proves their husband/wife truly cares about them?
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by bongodongobob on Saturday May 18, 2024 @08:02AM (#40398280)
If you think that people prefer real to artificial anything only because of marketing, you may be acoustic.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by throwaway11460 on Saturday May 18, 2024 @08:04AM (#40398288)
This particular case is very well known and proven to be caused directly by the marketing, yes.

There is no justifiable difference like beauty, durability or function between "real" and "artificial" diamonds. Only an expert can tell, and only because the "real" ones are less perfect. And of course - both are real diamonds.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by bongodongobob on Saturday May 18, 2024 @02:51PM (#40401117)
I'm not disputing that.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by chalcolithic on Saturday May 18, 2024 @08:35AM (#40398503)
Do they come along with lifelong sentences as opposed to artificial diamonds that are legal?
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by lr4444lr on Saturday May 18, 2024 @06:57AM (#40397926)
If the deep fake is of a real person, there is still reputation damage to the person featured.

That said, you're touching on something important. These people appear to be incurable, and it's about time we started talking about giving them some kind of outlet that mitigates the harm they might cause under the current regime of simply telling them they just have to restrain themselves. I don't know what the right answer is: VR? Sex dolls? Anything that will reduce the number of attempted incidents against actual children should be considered.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by soulofmischief on Saturday May 18, 2024 @07:29AM (#40398097)
> If the deep fake is of a real person, there is still reputation damage to the person featured.

Only if the material was distributed by the individual. If the material remained on the individual's computer, I just don't understand how someone can argue that harm has occurred.

Like, maybe there is an argument that some non-zero level of "harm" occurred due to perceived normalization of untoward behavior, but is this worth allowing a slippery slope with no immediately apparent bottom? Where will our benevolent government draw the line on what kind of thought crime is permissible?

It's getting really tiring that the only people routinely coming to bat over these kinds of issues are cybersecurity professionals and privacy advocates; the average person still seems to buy into this propaganda and it harms everyone in the end, as our collective ability to effectively fight bureaucratic tyranny becomes systematically reduced.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by ht85 on Saturday May 18, 2024 @07:18AM (#40398037)
> VR? Sex dolls?

Until now, VR child porn and child sized sex dolls were not on my mind when I thought of state sponsored healthcare.

I say this half jokingly, I am not really sure how I would want society to deal with that kind of mental illness. It's hard to have a nuanced perception of it, yet without nuance we are no better than the people we judge...

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by eastbound on Saturday May 18, 2024 @07:23AM (#40398057)
Especially since we’ve witnessed, after 20 years of porn on the internet, that far from resulting in youths being unfathomably promiscuous, it rather results in a youths not going out enough.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by chalcolithic on Saturday May 18, 2024 @08:45AM (#40398557)
Isn't imagination enough?
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by r0ckarong on Saturday May 18, 2024 @06:04AM (#40397724)
I think this new dimension makes things even worse. Soon everyone will be able to steal your image to depict you doing whatever they can think up that's disturbing to me. I know that you can do this with photo editing skills already but AI will be like the iPhone for abuse.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by rustcleaner on Saturday May 18, 2024 @06:18AM (#40397782)
I can already imagine you in drag and induce others to as well. Stop morally panicking before we accidentally cede even more liberty to the State!
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by RGamma on Saturday May 18, 2024 @07:12AM (#40398011)
Thankfully the legions of scammers have made many non-techies distrustful by default in some settings (e.g. personal finance, computer security). I think something like it will happen with gen AI stuff too. If everything can be fabricated at scale, doubt will be at the top of the mind and trusted channels will form.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by semi on Saturday May 18, 2024 @11:31AM (#40399826)
I'm not sure that's true though. It's always been more trivial to doctor a screenshot, even just editing a webpage in dev tools prior to taking a screenshot.

And yet people reshare and react to screenshots of tweets and similar all the time. The authenticity is only really questioned if it strongly goes against whatever narrative one already believes. And then that ability to fake them also gets used to dismiss legitimate honest information because it could have been faked.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by beaeglebeachedd on Saturday May 18, 2024 @06:22AM (#40397795)
If everyone fake, no one can. Maybe it will sabotage video as viable evidence and eliminate the surveillance apparatchik of cameras everywhere as useful in proving anything.
Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by ben_w on Saturday May 18, 2024 @07:14AM (#40398018)
That everyone can libel doesn't mean no one can.

That everyone can perjure themselves by libelling someone while under oath doesn't mean no one can.

And if anything, it would strengthen rather than eliminate surveillance apparatchik of cameras everywhere — as term "apparatchik" has its origins in soviet government, in this context it would therefore be exactly the subset of surveillance apparatus[0] that the government deemed trustworthy.

[0] and now I'm wondering if "apparatchik" was an auto-corrupt of "apparatus"?

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by llamaimperative on Saturday May 18, 2024 @07:38AM (#40398148)
You’re aware some people like having security cameras available to prove things, like who broke into their homes or jumped them on the street, right?

“Finally! We’ll have no way to prove anything at all! This is a big win!” Makes zero sense.

Re:DOJ: Man sentenced to 14 years for posession of deepfake ... by derkster on Saturday May 18, 2024 @06:23AM (#40397803)
Hard agree, I like to keep up with the newest models by throwing new haircuts on friends, making bad AI memes, just random stuff - and there's tons of models strictly for generating NSFW content. I saw a LoRA last night that was straight up called "facesitting", on the most popular hub to post/download models.

This is going to probably sound insane, but my primary concern is tech not being able to bridge the gap fast enough for this to be used to enhance our ability instead of enfeebling it.

But hey, maybe this is our centuries calculator and I'm just crazy.