News for hackers. Stuff that matters.
Re:New deepfake detector can spot a real/fake video based on... by rogers18445 on Friday November 18, 2022 @05:49PM (#33663776)
My understanding is that it's not quite that simple. GANs have stability problems (and as a result somewhat out of favor atm) and if the fake detection mechanism isn't a differentiable function itself no training can happen.
Re:New deepfake detector can spot a real/fake video based on... by sigmoid10 on Friday November 18, 2022 @05:59PM (#33663946)
The fake detection mechanism (aka discriminator) is usually just another neural network and I bet that's the case here as well. So it must be differentiable and thus, if anyone ever gets a hold of it, it could be easily used to train a generator that will eventually fool the discriminator.
Re:New deepfake detector can spot a real/fake video based on... by cudgy on Friday November 18, 2022 @09:05PM (#33665958)
So, basically a NOT operator on a neural network. Does this even require a differentiation?
Re:New deepfake detector can spot a real/fake video based on... by nl on Friday November 18, 2022 @11:37PM (#33666980)
A NN is trained to make something indistinguishable from reality as possible - so it can't tell the difference. The inverse of that will just claim reality is fake too.

What you need a a deep fake and a real video of the same thing, then train on the difference. Clearly this is impossible - which is what makes the problem hard.

Re:New deepfake detector can spot a real/fake video based on... by sigmoid10 on Saturday November 19, 2022 @05:32AM (#33668935)
You actually don't need that. You only need a set of real videos and a generator for fake ones. Then train the discriminator to tell these two classes apart and make use of its differentiability to update the generator in tandem with the discriminator.
Re:New deepfake detector can spot a real/fake video based on... by anankaie on Sunday November 20, 2022 @09:05AM (#33680964)
Would you run into class balance issues if you do not have a growing pool of initial videos?
Re:New deepfake detector can spot a real/fake video based on... by sigmoid10 on Sunday November 27, 2022 @01:00PM (#33764976)
Not if you have a balanced dataset. If not, you're already getting into trouble with GANs, which is why they were superseded by diffusers on image generation tasks.
Re:New deepfake detector can spot a real/fake video based on... by rusticpenn on Saturday November 19, 2022 @02:34AM (#33667954)
Not really a not operator. It’s more like tuning the generated models until the fake detector cannot detect it.
Re:New deepfake detector can spot a real/fake video based on... by anankaie on Sunday November 20, 2022 @09:03AM (#33680953)
It depends on how you set it up. You can use a very non-expressive valuation that assigns a score, but then you need to use reinforcement learning techniques to transform that score to a model update. Alternatively, if your valuation represents a differentiable metric function from your target you have a way of going directly from your output to a model update.

The second way requires dramatically fewer update steps (usually) than the first. Thus - having your adversarial target be differentiable definitely helps, though it is possible to do even absent such a criterion.

Re:New deepfake detector can spot a real/fake video based on... by jasonjmcghee on Saturday November 19, 2022 @12:52AM (#33667374)
It is accurate that GANs have stability problems, but they are absolutely being used today for solving problems similar to this (an output needs to be "improved").

Stable Diffusion produces faces- especially eyes that are malformed. You'll often see "restore faces" in online services which feeds the end result into a GFPGAN which is used to restore faces.

Re:New deepfake detector can spot a real/fake video based on... by anticensor on Saturday November 19, 2022 @03:31AM (#33668265)
Diffusors are not GANs.
Re:New deepfake detector can spot a real/fake video based on... by homarp on Saturday November 19, 2022 @04:02AM (#33668434)
indeed. that is why you use GAN to fix the face generated https://www.reddit.com/r/StableDiffusion/comments/x33rs4/how...
Re:New deepfake detector can spot a real/fake video based on... by snowpid on Saturday November 19, 2022 @04:23PM (#33674871)
While Gradient Descent needs differentiable functions, there are evolutionary algorithms that do not need this and can also train neural networks.