Re:New deepfake detector can spot a real/fake video based on...
by rogers18445 on Friday November 18, 2022 @05:49PM
(#33663776)
My understanding is that it's not quite that simple. GANs have stability problems (and as a result somewhat out of favor atm) and if the fake detection mechanism isn't a differentiable function itself no training can happen.
[ Parent
| on HN ]
Re:New deepfake detector can spot a real/fake video based on...
by sigmoid10 on Friday November 18, 2022 @05:59PM
(#33663946)
The fake detection mechanism (aka discriminator) is usually just another neural network and I bet that's the case here as well. So it must be differentiable and thus, if anyone ever gets a hold of it, it could be easily used to train a generator that will eventually fool the discriminator.
Re:New deepfake detector can spot a real/fake video based on...
by cudgy on Friday November 18, 2022 @09:05PM
(#33665958)
So, basically a NOT operator on a neural network. Does this even require a differentiation?
Re:New deepfake detector can spot a real/fake video based on...
by nl on Friday November 18, 2022 @11:37PM
(#33666980)
A NN is trained to make something indistinguishable from reality as possible - so it can't tell the difference. The inverse of that will just claim reality is fake too.
What you need a a deep fake and a real video of the same thing, then train on the difference. Clearly this is impossible - which is what makes the problem hard.
Re:New deepfake detector can spot a real/fake video based on...
by sigmoid10 on Saturday November 19, 2022 @05:32AM
(#33668935)
You actually don't need that. You only need a set of real videos and a generator for fake ones. Then train the discriminator to tell these two classes apart and make use of its differentiability to update the generator in tandem with the discriminator.
Re:New deepfake detector can spot a real/fake video based on...
by anankaie on Sunday November 20, 2022 @09:05AM
(#33680964)
Would you run into class balance issues if you do not have a growing pool of initial videos?
Re:New deepfake detector can spot a real/fake video based on...
by sigmoid10 on Sunday November 27, 2022 @01:00PM
(#33764976)
Not if you have a balanced dataset. If not, you're already getting into trouble with GANs, which is why they were superseded by diffusers on image generation tasks.
Re:New deepfake detector can spot a real/fake video based on...
by rusticpenn on Saturday November 19, 2022 @02:34AM
(#33667954)
Not really a not operator. It’s more like tuning the generated models until the fake detector cannot detect it.
Re:New deepfake detector can spot a real/fake video based on...
by anankaie on Sunday November 20, 2022 @09:03AM
(#33680953)
It depends on how you set it up. You can use a very non-expressive valuation that assigns a score, but then you need to use reinforcement learning techniques to transform that score to a model update. Alternatively, if your valuation represents a differentiable metric function from your target you have a way of going directly from your output to a model update.
The second way requires dramatically fewer update steps (usually) than the first. Thus - having your adversarial target be differentiable definitely helps, though it is possible to do even absent such a criterion.
Re:New deepfake detector can spot a real/fake video based on...
by jasonjmcghee on Saturday November 19, 2022 @12:52AM
(#33667374)
It is accurate that GANs have stability problems, but they are absolutely being used today for solving problems similar to this (an output needs to be "improved").
Stable Diffusion produces faces- especially eyes that are malformed. You'll often see "restore faces" in online services which feeds the end result into a GFPGAN which is used to restore faces.
Re:New deepfake detector can spot a real/fake video based on...
by anticensor on Saturday November 19, 2022 @03:31AM
(#33668265)
Diffusors are not GANs.
Re:New deepfake detector can spot a real/fake video based on...
by homarp on Saturday November 19, 2022 @04:02AM
(#33668434)
indeed. that is why you use GAN to fix the face generated https://www.reddit.com/r/StableDiffusion/comments/x33rs4/how...