This type of scenario seems like a very real concern to me. You can extend this example into practically any hot button issue.
Just telling everybody that you were told that this meeting happened through secret messages from a secret high-level traitor from the Soros Foundation would work just as well. It would work on hundreds of people even if you said that you were receiving these messages psychically or encoded through subtle changes in reruns of Law & Order.
In a highly polarized world people don't actually care about evaluating evidence. We pay attention to the voices that reinforce our beliefs and – at best – ignore those that don't.
We know this because that's exactly what ClimateGate was. A huge pile of hacked emails leaked, and they included climate scientists saying things like:
- The world had stopped warming and they couldn't explain that
- They were mixing and matching data to ensure graphs showed temperature's going up
- They were working to prevent papers that disagreed with them from being published
- They were deleting emails and other material to avoid having to release them
etc
Guess what - they denied everything, the emails were roundly denounced by a friendly media, and nothing happened to any of the people involved.
Really, you don't need deepfakes to create climatology skepticism. Climatologists are very good at creating it all by themselves.
Try: "Deepfakes aren't a huge concern because regular misinformation campaigns are still wildly successful."
I might go as far as to say: "Deepfakes aren't a huge concern because we live in a post-factual society, so evidence doesn't really matter."
> I might go as far as to say: "Deepfakes aren't a huge concern because we live in a post-factual society, so evidence doesn't really matter."
Deepfakes are concerning because they point to a future where disinformation is so effective that it's impossible to pierce a disinformation bubble and unreasonably difficult for a sensible person to avoid getting pulled into one.
Take the idea that the moon landings are a hoax. It relies on accepting the idea of a rather unbelievable and expensive (for the 60s) amount of fakery. Sure, people believe it anyway, but they have to try pretty hard. They wouldn't have to try so hard if someone had faked a convincing body of evidence that the landings were faked. Or they'd have to throw up their hands and give up if they understood how easily things could be faked with modern technology.
I would guess that people who believe in government conspiracies has low or even very low trust of the government. Give them an story that display that the government can't be trusted and people will attach themselves to the narritive in order to confirm how they feelt. They don't need to try hard to actually rationalize it, because the actually details are unimportant. The only thing that matters is the feeling of confirmation.
It is really hard to convince people out of a feeling by using facts and proofs, and a common statement during online discussion is that it is impossible.
I agree with this. I think the problem with deepfakes is that they could make it impossible rather than "really hard" to "convince people out of a feeling by using facts and proofs." Not only will those people have "a feeling" to back up their false beliefs, but they'll also have convincing fake "facts and proofs."
Those fake "facts and proofs" will also make it easier to convince others of the false beliefs. With deepfakes, it could be possible to convince someone with moderate to high "trust of government" of false government conspiracies (e.g. a convincing high-resolution deepfake showing Hillary Clinton knowingly engaging in child sex trafficking or talking about adrenochrome).
Is it too late to claim I wasn't sure whether the original comment came from a human or a GPT-3 instance? ;)
The gap between scientific consensus and common belief has been driven by "regular" misinformation campaigns: promotions of conspiracy theories, manufactured doubt, cherry-picking of claims.
Why worry about the novel when the basics are still working?