News for hackers. Stuff that matters.
Re:Avatarify lets users run realtime deepfakes on live video... by blackdogie on Saturday April 18, 2020 @07:38AM (#22907005)
I’m sure we will see more and more of this. One question is when they get so good, how can people figure out that it’s a deep fake or a real human? Will we have captchas for videos soon ? sigh
Re:Avatarify lets users run realtime deepfakes on live video... by astrobe_ on Saturday April 18, 2020 @11:47AM (#22908497)
Ask the person to turn their head left and right. Or to put on glasses. Combine simple tests like this and it becomes exponentially more complex for the gadget to pass them.
Re:Avatarify lets users run realtime deepfakes on live video... by undersuit on Saturday April 18, 2020 @02:37PM (#22910000)
Like the Turing Test computational attack from Rick and Morty.

Rick speaking to a crowd of hologram characters: Everyone who's first name starts with an "L" who isn't Hispanic, walk in a circle the same number of times as the square root of your age times ten! - https://www.imdb.com/title/tt3333830/

Re:Avatarify lets users run realtime deepfakes on live video... by bloopernova on Saturday April 18, 2020 @11:40AM (#22908456)
My opinion on this is that we will "soon" have "trusted" webcams that create some sort of signature in each frame. In other words, a way to say "this is what the camera saw, guaranteed".

Probably something that would be built into phones and laptops first.

Of course, we know that messing with such a datastream would be easy for us, but for enterprise users (think liability) and news organizations it could be a real boon.

Re:Avatarify lets users run realtime deepfakes on live video... by BenjiWiebe on Saturday April 18, 2020 @11:47AM (#22908496)
That's when you point your camera at a screen.
Re:Avatarify lets users run realtime deepfakes on live video... by toni on Saturday April 18, 2020 @12:18PM (#22908713)
Will the "trusted" webcam manufacturers then attempt to detect any screen curvature?
Re:Avatarify lets users run realtime deepfakes on live video... by PeterisP on Monday April 20, 2020 @08:18AM (#22923186)
Technically it would not be "this is what the camera saw, guaranteed" but "this is what the possessor of some signing key asserts they saw".

If a single shoddy manufacturer of cheap webcams somehow leaks a key that should have been on that webcam, then any software can easily encode a video stream with signatures asserting "this is what the camera saw, guaranteed".

Re:Avatarify lets users run realtime deepfakes on live video... by coder1001 on Saturday April 18, 2020 @07:42AM (#22907025)
Good question, maybe sign your videos with a key?

Or perhaps another neural network to distinguish the real from the fake?

Re:Avatarify lets users run realtime deepfakes on live video... by Der_Einzige on Saturday April 18, 2020 @08:12AM (#22907177)
Isn't that already done? They're called generative adversarial networks...
Re:Avatarify lets users run realtime deepfakes on live video... by elwell on Saturday April 18, 2020 @07:59AM (#22907108)
Yeah, the real reason Zoom should be actually be E2E encrypted.
Re:Avatarify lets users run realtime deepfakes on live video... by mikepurvis on Saturday April 18, 2020 @09:00AM (#22907403)
Authenticity is about signing more than encrypting. But having that actually work would require a robust key distribution system that's actually usable by the general public.
Re:Avatarify lets users run realtime deepfakes on live video... by stingraycharles on Saturday April 18, 2020 @07:43AM (#22907030)
If I understood it correctly, deepfakes are relatively easy to detect by software if you know what you’re looking for. I can imagine video conferencing software can implement this, and display a warning in similar ways that phishing emails are currently handled.
Re:Avatarify lets users run realtime deepfakes on live video... by wcoenen on Saturday April 18, 2020 @08:10AM (#22907161)
Deepfakes are implemented with Generative Adverserial Networks (GANs), where one component is a discriminative network that is already trying to distinguish real from fake, to provide feedback to the generation.

So I think any detection algorithms would get into a never-ending arms race.

Re:Avatarify lets users run realtime deepfakes on live video... by Hard_Space on Saturday April 18, 2020 @09:45AM (#22907677)
None of the popular distributions use GANs, except that GANs have been used in experimental (later abandoned) modules. Unfortunately the Deepfake/GAN fallacy has been stuck in the Wikipedia entry for years.
Re:Avatarify lets users run realtime deepfakes on live video... by im3w1l on Saturday April 18, 2020 @09:39AM (#22907624)
The discriminative networks aren't very good at discriminating. I remember hearing people in the field saying they deliberately used under-powered discriminators because they got better generators that way. Was a year or two ago though so who knows if that's still true.
Re:Avatarify lets users run realtime deepfakes on live video... by kevingadd on Saturday April 18, 2020 @07:45AM (#22907044)
Spotting it in a static photo may be harder, but the artifacts will be really obvious in a video until the technology progresses considerably
Re:Avatarify lets users run realtime deepfakes on live video... by KingFelix on Saturday April 18, 2020 @02:16PM (#22909796)
Voight-Kampff test