News for hackers. Stuff that matters.
Re:The road to realistic full-body deepfakes by skilled on Thursday September 22, 2022 @11:09AM (#32939936)
Hmm, this does make me wonder what kind of an effect will deepfakes have on people's general perception of the world?

I might be far fetching here, but wouldn't this lead to people being more mindful of what they watch and interact with? I think all that it will take is a few "state of the art" deepfakes to cause a ruckus and the domino effect should do the rest.

Anyone in the field spent time thinking on this or has had similar notions?

Re:The road to realistic full-body deepfakes by showerst on Thursday September 22, 2022 @11:33AM (#32940353)
Photoshop has been common knowledge for years, and people still buy some very dumb edits.

I imagine that deepfakes will follow a similar path to edited photos -- lots of deception, followed by trustworthy sources gaining a little more cachet, but with many people still getting fleeced. Skepticism will ramp up in direct relation to youth, wealth, and tech-savvy.

Re:The road to realistic full-body deepfakes by smrtinsert on Thursday September 22, 2022 @11:43AM (#32940523)
Even simple video fakes such as slowing down a politicians speech to make them look slow or indecisive has gone viral. It doesn't take state of the art to lie to those who prefer their own echo chamber.
Re:The road to realistic full-body deepfakes by autoexec on Thursday September 22, 2022 @05:10PM (#32944677)
Plenty of people have mislead others online with nothing but text! Ultimately we're going to have to just accept the fact that you can't believe everything you see on the internet.
Re:The road to realistic full-body deepfakes by kadoban on Thursday September 22, 2022 @05:28PM (#32944854)
Video is more effective than text, because people think they've seen whatever event and formed their own conclusions. Those are much stronger than just being told what happened.
Re:The road to realistic full-body deepfakes by autoexec on Thursday September 22, 2022 @06:00PM (#32945176)
I've seen it argued that text is worse because it forces people to read the words with their own inner voice. Somewhere in this discussion is a guy who linked to studies saying you are incapable of reading anything without believing it. (Do you believe me?)

Text, photoshop, special effects, deepfakes they're all just tools for spreading ideas, but we've been dealing (to some degree of success) with folks telling lies for as long as we've had language. I just can't see this fundamentally changing anything except the level of skepticism we give to video which (considering what hollywood has been capable of for some time) we should have been developing already.

Re:The road to realistic full-body deepfakes by kadoban on Thursday September 22, 2022 @08:14PM (#32946328)
> I've seen it argued that text is worse because it forces people to read the words with their own inner voice. Somewhere in this discussion is a guy who linked to studies saying you are incapable of reading anything without believing it.

Seems like there'd have to be some big caveats for that to be at all true, but it is interesting. I've read a lot of ridiculous crap and haven't been persuaded by much of it.

> (Do you believe me?)

No.

Re:The road to realistic full-body deepfakes by autoexec on Thursday September 22, 2022 @08:38PM (#32946514)
You've just disproved his point, but it was here: https://news.ycombinator.com/item?id=32939058#32940128
Re:The road to realistic full-body deepfakes by kadoban on Thursday September 22, 2022 @09:02PM (#32946693)
Ahh, that study. That's an interesting one. I don't think I'd summarize it as "we believe what we read" so much as "correcting false information isn't as easy as telling people they're wrong".
Re:The road to realistic full-body deepfakes by e40 on Thursday September 22, 2022 @11:52AM (#32940684)
I think it will make it far easier to manipulate dumb people. The same 30% (?) of the people who think the last US Presidential election was stolen. These people will be easier to whip into a frenzy. I worry this will increase the likelihood of violence, above what is already happening.
Re:The road to realistic full-body deepfakes by tryauuum on Thursday September 22, 2022 @12:26PM (#32941186)
(as a non-american) I don't think it was stolen, but the whole "vote via mail" thing made me really suspicious
Re:The road to realistic full-body deepfakes by diputsmonro on Thursday September 22, 2022 @01:30PM (#32942050)
It really is nothing to be suspicious about. Full vote by mail had already been the norm in some US states for years, and most states allowed for it in specific circumstances. The infrastructure, laws, etc., were already there, they just needed to be expanded. Expanding it has always been in the national conversation, it has just been a matter of figuring it out and priority.

So when a global pandemic occurs and we're trying everything we can to isolate and socially distance, that priority changes real quick. People get talking and problems get solved.

Of course, sore losers will complain about anything to justify their loss, and this "new thing" was a prime scapegoat. It was also well known ahead of time that the mail in votes would be largely Democratic (because COVID was VERY politicized and democrats were more likely to follow quarantine guidance and therefore vote by mail). So when the votes came in, they pointed to that imbalance and called it "fraud".

Besides all that, there's no reason to be more suspicious of mail-in ballots than in-person ones. In-person, you mark a paper ballot and then put it in a stack... which then gets mailed somewhere else. If someone is going to be changing mail-in ballots, then they're already in a position to be changing regular ones as well (and every election security professional will tell you that paper ballots are more secure than electronic ones).

Re:The road to realistic full-body deepfakes by tryauuum on Thursday September 22, 2022 @02:21PM (#32942690)
It's true that the one who counts the votes matters and this doesn't change with mail voting / in-person voting

The one advantage of physical voting I can think of is the ability to just be close to voting station on voting day, counting people who go in there, asking people (who are willing to share) for whom did they vote. This allows to independently check if fraud exists.

Re:The road to realistic full-body deepfakes by gcanyon on Thursday September 22, 2022 @05:05PM (#32944626)
Exit polls are notoriously inaccurate. Given the level of fraud thus far demonstrated (minimal) there is zero likelihood of "checking" by exit polls.
Re:The road to realistic full-body deepfakes by fknorangesite on Thursday September 22, 2022 @12:29PM (#32941220)
> the whole "vote via mail" thing made me really suspicious

Why? Mail-in voting is hardly unique to the US; what made you suspicious?

Re:The road to realistic full-body deepfakes by tryauuum on Thursday September 22, 2022 @12:58PM (#32941605)
quite unique for my country (Russia). Though they recently started to do some remote "blockchain-based" voting in Moscow, which is widely considered to be a fraud
Re:The road to realistic full-body deepfakes by mr_toad on Thursday September 22, 2022 @10:29PM (#32947304)
I think most people outside Russia (and some inside it) consider all Russian elections to be fraudulent.
Re:The road to realistic full-body deepfakes by tryauuum on Friday September 23, 2022 @10:36AM (#32952506)
that's not the point. The point is, we don't have voting by mail in Russia and I think it help to observe how fraudulent the elections are.
Re:The road to realistic full-body deepfakes by foobiekr on Thursday September 22, 2022 @03:00PM (#32943175)
I mean.. most things blockchain are.
Re:The road to realistic full-body deepfakes by astrange on Thursday September 22, 2022 @08:27PM (#32946430)
The issue with mail-in voting is that you can be influenced by your family because it's not done in a secret booth, but it doesn't appear to lead to mass voter fraud.

(A few people have been charged with voting their spouse's ballots.)

Re:The road to realistic full-body deepfakes by Turing_Machine on Thursday September 22, 2022 @12:26PM (#32941190)
As opposed to the dumb people who spent 4 years claiming the last-but-one presidential election was stolen, you mean?
Re:The road to realistic full-body deepfakes by capitalsigma on Thursday September 22, 2022 @12:45PM (#32941408)
I never heard that claim. Only "the electoral college is a bad system" or "voters were influenced by Russian propaganda." Never "votes were impacted by direct fraud."
Re:The road to realistic full-body deepfakes by sjsdaiuasgdia on Thursday September 22, 2022 @01:23PM (#32941942)
There were fraud claims on the fringe just after the 2016 election. The evidence was sparse. It didn't take long for even those pretty angry about the election to realize fraud probably didn't happen, and if it did it was at too small a scale to meaningfully affect the results.

Unfortunately in 2020 the fringe became the GOP mainstream, treating equally soft claims as fact.

Re:The road to realistic full-body deepfakes by Turing_Machine on Thursday September 22, 2022 @03:26PM (#32943525)
No, it wasn't "on the fringe". Note that this poll was taken in 2020, a full four years later.

"Seventy-two percent (72%) of Democrats believe it’s likely the 2016 election outcome was changed by Russian interference, but that opinion is shared by only 30% of Republicans and 39% of voters not affiliated with either major party."

https://www.rasmussenreports.com/public_content/politics/gen...

Re:The road to realistic full-body deepfakes by sjsdaiuasgdia on Thursday September 22, 2022 @03:32PM (#32943601)
By fraud I mean actual voter fraud. As in, effort was made to cause invalid votes to be counted or valid votes to not be counted.

Russia absolutely did and continues to push propaganda into elections in the USA and elsewhere. That's not really in dispute at this point so I'm not surprised it polls that high.

Got a poll that shows similar numbers for fraud? I would be genuinely surprised to see that.

Re:The road to realistic full-body deepfakes by Turing_Machine on Thursday September 22, 2022 @04:07PM (#32943968)
There were many claims that voters were illegitimately purged from the rolls, which is pretty much the equivalent.

I should actually note here that I didn't vote for Trump, either time, nor did I vote for Clinton or Biden.

I just hate hypocrisy.

Re:The road to realistic full-body deepfakes by seba_dos1 on Thursday September 22, 2022 @10:38PM (#32947362)
> it’s likely the 2016 election outcome was changed by Russian interference

That sounds like a perfectly reasonable claim with evidence that supports it, paralleled by other elections in other countries as well; quite obviously very different to what was discussed above.

Re:The road to realistic full-body deepfakes by Turing_Machine on Thursday September 22, 2022 @03:23PM (#32943490)
Then you weren't listening. People were screaming "Russia stole the election" from Day 1, not "just voters were influenced by Russian propaganda". You're spinning.
Re:The road to realistic full-body deepfakes by bdowling on Thursday September 22, 2022 @02:32PM (#32942818)
In 2019, Hillary Clinton, in a CBS News interview, called Trump “illegitimate”, claimed that Trump “stole” the election, and accused him of voter manipulation, including “hacking”.

https://www.washingtonpost.com/politics/hillary-clinton-trum...

Re:The road to realistic full-body deepfakes by gcanyon on Thursday September 22, 2022 @05:01PM (#32944586)
I don't think she means what you think she means by "hacking." I think she means this: https://www.nytimes.com/2016/12/09/us/obama-russia-election-...
Re:The road to realistic full-body deepfakes by notdonspaulding on Thursday September 22, 2022 @04:51PM (#32944468)
In terms of claiming the results of the election is illegitimate, "voters were influenced by Russian propaganda" instead of "votes were impacted by direct fraud" seems like a distinction without a difference to me.

https://news.yahoo.com/hillary-clinton-maintains-2016-electi...

In 2020, Hillary Clinton was still casting aspersions regarding the outcome of the 2016 election, sowing discontent about the electoral college, preparing Democrat voters to ignore the results until Joe Biden was declared the winner.

Portraying this game as if it's only being played by one team does not help restore any trust in the federal election process.

Re:The road to realistic full-body deepfakes by jacobolus on Thursday September 22, 2022 @02:53PM (#32943088)
The last-but-one presidential election was affected by various states illegally throwing large numbers of legal voters off their voter rolls, but it’s impossible to say whether it would have made enough difference to alter the outcome, and there’s no convincing evidence votes were directly changed. (It would be a good thing to have a verifiable paper trail for every election; in some parts of the USA it is impossible to effectively investigate any alleged shenanigans.)

The bigger problem in that election was Russian-intelligence-stolen (and possibly tampered with) documents being released to the press in the lead up to the election in coordination with the Trump campaign (with the FBI keeping its investigation of that secret), and then the FBI director making an unprecedented and (we found out only afterward) unsupportable statement attacking Clinton immediately before the election, after being pressured into it by a handful rogue FBI agents who were friends of Trump’s campaign threatening insubordination.

And perhaps the biggest problem of all, an entirely too credulous mainstream media who didn’t put those developments in context, leaving voters to draw mistaken inferences, and giving oodles of free airtime to Trump’s rallies without making any effort to dispute outright lying in real time.

Re:The road to realistic full-body deepfakes by thedorkknight on Thursday September 22, 2022 @01:25PM (#32941974)
I live in a liberal city and didn't hear this from anyone. The was initially a decent bit of "not my president" attitude, but just in a philosophical sense, and even that petered out pretty fast.
Re:The road to realistic full-body deepfakes by Turing_Machine on Thursday September 22, 2022 @03:31PM (#32943591)
Hillary Clinton herself claimed that the election was stolen and that Trump was an "illegitimate President".

But she doesn't count as "anyone", I guess?

Re:The road to realistic full-body deepfakes by thedorkknight on Thursday September 22, 2022 @09:48PM (#32947048)
She'd count as one single individual, yes. Thankfully a far cry from the amount that the comment above was referring to: https://news.ycombinator.com/item?id=32940684
Re:The road to realistic full-body deepfakes by e40 on Thursday September 22, 2022 @01:48PM (#32942285)
Did you hear that from Fox News? Because I never heard it once.
Re:The road to realistic full-body deepfakes by Turing_Machine on Thursday September 22, 2022 @03:26PM (#32943528)
Then you weren't listening. Note the quote above from Hillary Clinton herself.
Re:The road to realistic full-body deepfakes by costigan on Thursday September 22, 2022 @04:34PM (#32944281)
Stolen is a vague word. If there's evidence she believes there was sufficient fraud to have changed the result, I would be interested. If she was referring to the stolen Podesta emails and Comey's statement right before the election, then those things happened. You may think those things didn't matter, but it's no surprise she does. And then there's the whole storming the capital thing she didn't do.
Re:The road to realistic full-body deepfakes by gcanyon on Thursday September 22, 2022 @05:04PM (#32944608)
I think Clinton was referring to this: https://www.nytimes.com/2016/12/09/us/obama-russia-election-...

In other words: not saying that there was actual fraud sufficient to change the election, not saying the election was "stolen" in the sense people seem to be saying here.

Re:The road to realistic full-body deepfakes by e40 on Friday September 23, 2022 @06:00PM (#32957633)
Nah, that's not the same.

Stolen by foreign influence is very different than what the 2020 nuts have claimed. How many court cases did they lose? How many times were they asked to produce evidence and came up with ... nothing?

Re:The road to realistic full-body deepfakes by Swizec on Thursday September 22, 2022 @11:21AM (#32940128)
As Abe Lincoln always said: Don't believe everything you read on the internet.

But we do.

There's research. Even if you read something that you know is wrong you still believe it. Especially when distracted or not taking the time to analyze. As we rarely do.

https://techcrunch.com/2013/01/24/study-finds-that-we-still-...

https://www.businessinsider.com/why-you-believe-everything-y...

https://pubmed.ncbi.nlm.nih.gov/8366418/

Re:The road to realistic full-body deepfakes by autoexec on Thursday September 22, 2022 @05:37PM (#32944944)
> Even if you read something that you know is wrong you still believe it.

That seems like bullshit to me. I read your words (you even posted links!) so how come I don't just instantly believe you? If it were true, wouldn't it make all fiction inherently dangerous?

Let's see how it holds up in real life... here's a lie: "My uncle works at Nintendo and he told me that Mario (Jumpman at the time) was originally intended to only have one testicle, but the NES (famicom) didn't have powerful enough graphics to show that so they scraped that part of his official character design and have left the number of testicles unspecified ever since."

Somewhere, secretly deep inside you, do you believe that now?

Nah. I think we don't have to worry about people believing everything just because they read it. Reading things can put ideas into your head (have you ever even considered Mario's testicles before today?) but at this point we're straining the hell out of "belief" and going into philosophical arguments. In real life though, we are capable as a species of separating fact from fiction some of the time.

Re:The road to realistic full-body deepfakes by krapp on Thursday September 22, 2022 @10:38PM (#32947354)
It obviously doesn't work if you only say it once. It does work if you repeat it often enough. If you surround someone in a self-reinforcing bubble of misinformation, and all of their friends not only believe it, but dismiss and ridicule anyone who doubts it. If people make convincing arguments supporting it.

It works because people don't judge truth based on sober, rational, purely logical analysis but emotion and bias and most importantly comfort. If you're in an environment in which everyone believes X, you will inevitably begin to conform if the social pressures to do so are strong enough, and counter-signals weak enough. This is how radicalization works, through the gradual osmosis of a worldview, and the acceptance of smaller lies that lead to accepting bigger lies. It's how Nazi propaganda worked, and it's how modern advertising and politics work. It's why witness testimony is unreliable and how police can convince suspects that they committed a crime they went in knowing they were innocent of.

The effect isn't universal - nothing about human psychology is. But it is real.

Re:The road to realistic full-body deepfakes by autoexec on Thursday September 22, 2022 @11:18PM (#32947612)
> It obviously doesn't work if you only say it once. It does work if you repeat it often enough.

Repetition isn't enough, but I'll accept that with enough effort from enough people you might eventually be gaslit or brainwashed into believing just about anything so long as it didn't violate some fundamental aspect of your identity in which case it's more likely you'll just lie about believing it to make your life easier.

Re:The road to realistic full-body deepfakes by tsol on Thursday September 22, 2022 @11:40AM (#32940474)
I have suspected similarly. Skepticism and critical thinking are useful devices, but they can't always tell a truth from a lie. And even if they could-- humans aren't totally rational beings. Sometimes we believe lies because we want it to be true or because everyone around us does. Hell sometimes people believe things just to win an argument
Re:The road to realistic full-body deepfakes by bsenftner on Thursday September 22, 2022 @04:55PM (#32944522)
Back in '02-'04 I was a former games/graphics programmer working as a digital artist in feature film VFX. One area I specialized in was stunt double actor replacements. Working on Disney's "Ice Princess" I fixed a stunt double replacement shot and realized a method of making the entire process generic, at feature film quality.

By '06 I had an MBA with a Masters Thesis on the creation of a new Advertising format where the viewer, their family and friends are inserted into brand advertising for online advertising. By '08 I had global patents and an operating demonstration VFX pipeline specific for actor replacements at scale. However, it was the financial crisis of '08 and nobody in the general public had ever conceived of automated actor replacements. This was 5-7 years before the term deep fake became known. VCs simply disbelieved the technology was possible, even when demonstrated before their eyes.

Going the angel investor route, 3 different times I formed an investor pool only to have at some point them realize what the technology could do with pornography, and then the investors insist the company pursue porn. However, we had Academy Award winning people in the company, why would they do porn? We refused and that was the end of those investors. With an agency for full motion video actor replacement advertising not getting financing, the award winning VFX people left and the company pivoted to the games industry - making realistic 3D avatars of game players. That effort was fully built out by '10, but the global patents were expensive to maintain and the games industry producers and studios I met simply wanted the service for free. Struggled for a few years. We closed, sold the patents, and I went into facial recognition.

https://patents.justia.com/inventor/blake-senftner https://www.youtube.com/watch?v=lELORWgaudU

I was bitter about this all for a long time.

Re:The road to realistic full-body deepfakes by autoexec on Friday September 23, 2022 @12:00AM (#32947883)
> Going the angel investor route, 3 different times I formed an investor pool only to have at some point them realize what the technology could do with pornography, and then the investors insist the company pursue porn.

I'm not sure there's a huge market for people wanting to insert their friends and family into porn, but if there was why not just try it? Seems like it'd have demonstrated the tech worked commercially which could have attracted investment in non-pron uses and it could have ended up just one more technology in a long list of tech made successful as a result of porn.

Re:The road to realistic full-body deepfakes by bsenftner on Friday September 23, 2022 @10:54AM (#32952755)
Such a service would be a lawsuit engine, the social pushback from the female population towards the creators of such a service would significant, and then the public impression of the technology would be "tainted with porn" if ever attempted with brand advertising.

Meanwhile, simply the process of inserting consumers in the trailer of any Marvel superhero film and charging $1 for you own copy would make tens of millions. Repeat with any highly desirable fantasy franchise. That is the most obvious application. Actor replacement with ordinary people has a huge number of positive to society applications. Porn is not one of them.

Re:The road to realistic full-body deepfakes by tshaddox on Thursday September 22, 2022 @02:49PM (#32943040)
I don't think it will change much.

I think for claims that you think are important to determine an objective truth value for (like who the President of the U.S. is), your determinism mechanism is based on trusting sources you deem reliable and looking for broad agreement among many sources you deem to be independent. You're probably not just looking at a single sourceless video of Ronald Reagan behaving as if he's the president and believing that claim because the video couldn't possibly have been faked.

And for other claim that you don't think are important to determine an objective truth value for, I don't think you need very high-fidelity evidence anyway. For example, people have no trouble believing claims that corroborate their closely-held ideologies even with very low-fidelity fraudulent evidence, or even claims made with no attempt whatsoever to provide even fraudulent evidence!

Re:The road to realistic full-body deepfakes by arcticfox on Thursday September 22, 2022 @11:44PM (#32947784)
I agree with your framework, but what happens when the sources I deem reliable can't trust their own eyes?

A lot of people point to Photoshop not breaking truth, but in my experience, we simply rely on video instead. When I served on a grand jury, essentially all of the non-testimony evidence I saw was video, and it was incredibly compelling. Neutering the reliability of that evidence will hurt.

Re:The road to realistic full-body deepfakes by aimor on Thursday September 22, 2022 @01:21PM (#32941919)
We (people) already accept the lies we perceive. I think we choose to accept these fantasies because they're often outside our direct influence and when something is distant from us we have the luxury of turning it into entertainment. I think of beauty in media, every video we see today is processed to make people look pretty. Most play along with the fantasy: admire old celebrities for not aging, complement friends for clear skin. But when a friend says, "I feel so ugly" we move closer to reality and acknowledge the makeup, beauty filters, etc. The same effect happens in politics, news, business, technology: people indulge in fantasy at their convenience.

I don't think people will be more mindful of what they watch and believe, I think the opposite will happen: an attraction to fake content. People will embrace the fantasy and share deepfakes at a scale so large governments will be running campaigns to alert the public that such-and-such video is fake, possibly attempting to regulate how content shared online must be labeled.

That said I still believe when these lies are closer to us, enough for us to care either as professionals or friends and family, that we will be more discerning about reality.

Re:The road to realistic full-body deepfakes by kyleplum on Thursday September 22, 2022 @12:55PM (#32941552)
There are ongoing efforts to enable digital signatures of online media. The idea is that you (or your browser) can validate that an image or video is unmodified from the source that produced it.

https://contentauthenticity.org/

Re:The road to realistic full-body deepfakes by russdill on Thursday September 22, 2022 @02:35PM (#32942861)
There are so many technical hurdles to something like this, I don't see it as a solution anytime soon or ever.
Re:The road to realistic full-body deepfakes by kyleplum on Thursday September 22, 2022 @03:10PM (#32943318)
It's not as far away as one might think.

There was a demo earlier this year (Jan) showcasing the proposed 1.0 spec working in Microsoft Edge: https://c2pa.org/jan-2022_event/

Re:The road to realistic full-body deepfakes by russdill on Thursday September 22, 2022 @06:04PM (#32945227)
The browser side is not where all the hurdles occur. It's on the capture side and the key/certificate management/revocation side.
Re:The road to realistic full-body deepfakes by 6gvONxR4sf7o on Thursday September 22, 2022 @11:28AM (#32940250)
I’d love that to be true, but I think we can use text on social media as a guide here. It’s already as easy to type a lie as typing the truth, and I’m pretty sure lots of made up comments/posts on reddit get taken as truth by tons of people, for example.
Re:The road to realistic full-body deepfakes by wussboy on Thursday September 22, 2022 @11:54AM (#32940713)
I think we will get to a point where trust will only come from face-to-face physical meetings. We won't be able to believe in Zoom calls, phone calls, nothing except face-to-face.

Just like it was for millions of years before now.

Re:The road to realistic full-body deepfakes by MonkeyMalarky on Thursday September 22, 2022 @12:38PM (#32941332)
It's already become an arms race. KYC identity services are already adding liveness and deep fake detection features.
Re:The road to realistic full-body deepfakes by intrasight on Thursday September 22, 2022 @12:50PM (#32941484)
In the future, TVs and monitors and smartphones will have built-in "truth meters".

Face-to-face is only applicable with you small social network.

Re:The road to realistic full-body deepfakes by wussboy on Thursday September 22, 2022 @07:43PM (#32946093)
> Face-to-face is only applicable with you small social network.

That is my point precisely. And I will point out here that small social networks are our historical environment. I believe not only can we return to them and flourish, but also that it would be a great boon to human flourishing, the only outcome that really matters.

Re:The road to realistic full-body deepfakes by intrasight on Thursday September 22, 2022 @11:14PM (#32947591)
I agree but I'm afraid that we're moving in the opposite direction. VR and deep fakes will make for interesting times.

I've worked at home for nearly 20 years so I've had to learn to create a strong in-person social network. The pandemic and some medical issues have interfered, but I still much more enjoy having fun with my friends than doing things online.

Re:The road to realistic full-body deepfakes by hombre_fatal on Thursday September 22, 2022 @04:13PM (#32944035)
> wouldn't this lead to people being more mindful of what they watch and interact with?

No. We have already run the case study where people on Reddit, Twitter, and other social media will seethe at mere screenshots of headlines and captions under a picture with zero need for verification.

Here on HN we will pile into the comments to react to the title without even clicking the link to read it ourselves.

Deepfakes feel like a drop in the bucket. What does it matter that you can deepfake a president when people will simply believe a claim about the president than spreads around social media? I don’t see it.

Re:The road to realistic full-body deepfakes by cortesoft on Thursday September 22, 2022 @11:58AM (#32940769)
No, people will continue to believe as true videos that match their expectations and disbelieve those that don't
Re:The road to realistic full-body deepfakes by jsty on Thursday September 22, 2022 @11:21AM (#32940118)
If you have access to BBC iPlayer, "The Capture" is a really good fictional programme / drama exploring the possible implications re. justice and politics
Re:The road to realistic full-body deepfakes by wingspar on Thursday September 22, 2022 @11:31AM (#32940332)
In the US, it’s on Peacock. Enjoyed it very much. I think we had watched it on PBS.

It’s a surveillance thriller.

Re:The road to realistic full-body deepfakes by drc500free on Thursday September 22, 2022 @02:55PM (#32943112)
The ability to use this to plausibly deny any real evidence is more chilling than the fake evidence that could be created.
Re:The road to realistic full-body deepfakes by aaroninsf on Thursday September 22, 2022 @02:45PM (#32943003)
Why yes.

Let me quote myself from a discussion I was having this morning with a friend who is a tenured professor of philosophy working on AI (as an ethics specialist his work is in oversight),

we were discussing the work shared on HN this week showing a proof-of-concept of Stable Diffusion as better at image "compression" than existing webstandards.

I was very provoked by commentary here about the high "quality" images produced, it was clear that they could in theory contain arbitrary levels of detail—but detail that was confabulated, not encoded in any sense except diffusely in the model training set.

"I'm definitely inclined to push hard on the confabulation vs compression distinction, and by extension the ramifications.

I see there a very meaningful qualitative distinction [between state of the art "compression" techniques, and confabulation by ML] and, an instrumental consequence which has a long shadow.

The thing I am focused on being, whether or not the fact that a media object is lossy or not can be determined, even under even forensic scrutiny.

There was a story I saw this week about the arms race in detection of 'deep fake' reproduction of voice... which now requires some pretty sophisticated models itself. Naturally I think this is an arms race in which the cost of detection is going to rapidly become infeasible except to the NSA. And maybe ultimately, infeasible full stop.

So yeah, I think we're at a phase change already, which absolutely has been approaching, back to Soviet photo retouching and before, forgery and spycraft since forever... so many examples e.g. the story that went around a couple years ago about historians being up in arms about the fad for "restoring" and upscaling antique film and photographs, the issue of concern being that so much of that kind of restoration is confabulation and the presumptive dangers of mistaking compelling restoration for truth in some critical detail. Which at the time mostly seemed a concern for people who use the word hermeneutics unironically...

...but we now reach a critical inflection point where society as a whole integrates the notion that no media object no matter "convincing" can be trusted,

and the consequent really hard problems about how we find consensus, and how we defend ourselves against bad actors who actively seek their Orbis Tertius Christofascist kingdom of rewritten history and alternative facts.

The derisive "fake news" married to indetectably confabulated media is a really potent admixture!"

Re:The road to realistic full-body deepfakes by gcanyon on Thursday September 22, 2022 @05:58PM (#32945163)
Once you accept lossy compression, it becomes a question of what level and type of "lossy" you're willing to accept, and how clever the "compression" algorithm can be.

If I want to compress the movie Thunderball -- a sufficiently clever "compression" algorithm could start with the synopsis at https://en.wikipedia.org/wiki/Thunderball_(film) add in some images of Sean Connery, and generate the film. That's...maybe a 100K to 1 compression ratio?

If the algorithm itself understands "Sean Connery" then you could (theoretically) literally feed in the text description and achieve a reasonable result. I've seen Thunderball, but it was years ago and I don't remember the plot (boats?). I'd know the result was different, but I likely wouldn't be able to point to anything specific.

Re:The road to realistic full-body deepfakes by permo-w on Thursday September 22, 2022 @08:14PM (#32946331)
I really think there is absolutely nothing to worry about.

put it this way:

written text has always been extremely mutable and therefore falsifiable. video is simply going to become more like text. people will trust it based on the context and their own judgment rather than the content. I suspect most people already do this anyway

Re:The road to realistic full-body deepfakes by ilaksh on Thursday September 22, 2022 @04:14PM (#32944042)
I actually think that live, full body AI-generated realistic avatars (sometimes imitating celebrities to one degree or another) will become an everyday part of life for many people within the next 5-10 years.

I assume that full-on impersonation will still be illegal, but certain looks that are sometimes quite similar to a real celebrity will trend now and then.

The context for this is the continual improvement in the capabilities and comfort of VR/AR devices. The biggest one I think is going to be lightweight goggles and eventually glasses. But also the ability to stream realistic 3d scenes and people using AI compression (including erasing the goggles or glasses if desired) could make the concept of going to a physical place for an event or even looking exactly like yourself feel somewhat quaint.

Re:The road to realistic full-body deepfakes by bsenftner on Thursday September 22, 2022 @11:45PM (#32947792)
Nobody seems to realize, the value is in inserting ordinary people into media with celebrities! Perfect for brand name advertising, you with a celebrity telling you how smart you are for using they brand they pitch.

I formally built an ad agency with a feature film VFX pipeline for actor replacement advertising - but I built it back in '08, years before "deep fakes" and nobody believed what I had working was possible.

Re:The road to realistic full-body deepfakes by 2OEH8eoCRo0 on Thursday September 22, 2022 @01:26PM (#32941978)
I can't wait to just generate pornography on the fly while wearing a body monitor so that it can fine tune female body proportions to my exact specifications.
Re:The road to realistic full-body deepfakes by AlecSchueler on Thursday September 22, 2022 @01:33PM (#32942088)
Does that sound healthy? Personally or socially? I'd worry about how that would affect my view of the real women around me and, in turn, my behaviors towards others.
Re:The road to realistic full-body deepfakes by 2OEH8eoCRo0 on Thursday September 22, 2022 @01:35PM (#32942106)
Definitely not. It actually scares me what future we are heading towards. Supernormal stimulus. Better than a human partner could ever be. Super addicting in a primordial way.
Re:The road to realistic full-body deepfakes by autoexec on Thursday September 22, 2022 @05:20PM (#32944759)
I'm guessing that most people will have very little trouble separating reality from fantasy.
Re:The road to realistic full-body deepfakes by alecfreudenberg on Thursday September 22, 2022 @11:15AM (#32940031)
Yeah a little more skepticism will be nice, but I still personally see myself getting fleeced every now and then.
Re:The road to realistic full-body deepfakes by jjoonathan on Thursday September 22, 2022 @11:19AM (#32940101)
It will also lead to "that's a deepfake!" as an excuse given after getting caught on camera.
Re:The road to realistic full-body deepfakes by Loughla on Thursday September 22, 2022 @02:29PM (#32942783)
Bingo.

It's less about using fakes to push your agenda, and more about being able to (plausibly or implausibly it doesn't matter) claim that whatever video is a deepfake.

The truth is meaningless, and as tools like deepfakes become more and more sophisticated, it's harder and harder to establish baseline realities.

And someone is benefiting from that shift away from reality, I just don't know who.

Re:The road to realistic full-body deepfakes by autoexec on Thursday September 22, 2022 @05:28PM (#32944855)
which will lead to people trusting forensic experts and corroborating data/witnesses. If you were a Karen caught in an embarrassing public meltdown you could absolutely say that the video was deepfaked and you were really just home alone sleeping at the time, but when 7 different people's cell phone videos, multiple security cameras, two dashcams, 14 ring cams, GPS data captured from your mobile device, and one police surveillance drone all agree it was you that's not going to work out so well.

People made the same arguments about photoshop, but it's really not a problem. Almost never is a single video the only evidence of anything and in the cases where it is and that video can't be verified it's probably best not to ruin someone's life over it.

Re:The road to realistic full-body deepfakes by dagurp on Thursday September 22, 2022 @11:45AM (#32940546)
Let's just hope that fake detection technology stays ahead of any innovations in this field
Re:The road to realistic full-body deepfakes by thrown_22 on Thursday September 22, 2022 @05:00PM (#32944573)
>Anyone in the field spent time thinking on this or has had similar notions?

Skepticism in general will only be applied to people we don't like and ignored for people we do.

The continued lapping up of blatant Ukrainian propaganda in mains stream media for example doesn't even need photoshop to be believed, just the vague 'sources said'.

Re:The road to realistic full-body deepfakes by bregma on Thursday September 22, 2022 @01:50PM (#32942322)
> wouldn't this lead to people being more mindful of what they watch and interact with?

Have you been paying any attention to what's going on the last several years?

Re:The road to realistic full-body deepfakes by NavinF on Thursday September 22, 2022 @12:35PM (#32941296)