- Watermarks are optional by AI provider so bad actors will circumvent by using another provider
- GH project proves watermarks can be removed
Given these, trying to ensure "truth" is a futile effort unfortunately, and watermarking only gives companies advantage to violate privacy
The photo could be staged (e.g. Cottingley Fairies), it could be altered physically (like cutting or painting over, e.g. Stalin), it could be cropped intentionally to tell a different story (plenty of examples), and more recently it could be photoshopped, etc. All of these were possible, though harder than it is now, but let's not pretend we didn't "trust pixels". We all did, just as we trusted newspaper photographs. Now that era must come to a firm end, and I believe it's a tragedy.
A knife and a handgun aren’t comparable to a machine gun and a bomb. When you have equal access to all of those, the damage you can enact is exponentiated.
You could lie with text before, but it took effort and time and skill to do it convincingly. You could also lie with images but they took even more time and effort and skill, greatly limiting the pool of people who could do it and the possible damage.
When anyone anywhere can convincingly lie and have it do two laps around the world in a matter of minutes, the whole game changes.
It’s becoming very hard to believe that people making arguments like yours are doing so in good faith. Maybe you’re not even a person but a shill bot. That’s a very real and trivial possibility today, which is the whole point and illustrates the problem.
AI media generation is a red herring, the main thing is tracking, ID verification, constant social credit-like ratings, etc. That's what is coming.
Edit: Removed swipes while keeping the core argument.
> Label them as irredeemable liars so you can do as you please.
Do you not see the irony?
I disagree with the irony point on the basis that none of us here (I assume) is a despot or in a position of power high enough to lie to the point of discrediting entire institutions to the masses. We can be victims of it, but not perpetrators. Also, nowhere have I accused anyone in particular of being a liar. Still, given that my ill chosen words will have no doubt clouded your understanding of the point—which is on me—I won’t hold that against you, I take responsibility.
It can be both things.
I worry about tracking and the post-truth world of everything fake and AI slop infiltrating everything. And like the person you're arguing with is saying, just because slop/fakery was possible before doesn't mean the widespread scale that AI and the internet have unlocked is of no concern.
You know what would be a good counter to that? Don't use AI generation tools if they implement that. The argument that 'we should let AI generated media be indistinguishable from the truth because what if Google does something you don't like at some point' is pretty flimsy.
As I said, it can be both things, both bad.
Now that anyone can manufacture convincing images out of whole cloth, it becomes impossible for the typical user to determine if what they're seeing is legitimate; this means not only that people can manufacture images to push a false narrative but also discredit legitimate images as falsified.
The 'mainstream media is bad' narrative is one manufactured almost entirely by right-wing influencers and politicians to create an environment where they can discredit any actual evidence that doesn't align with what they or their base want to hear. Once anyone with integrity is inherently suspicious, the narrative can be set by anyone to push their agenda, and because they've demonized actual news reporting they can point to any other outlet that counters their claims and say 'look, they're lying to your face, you can't trust them!'
> the main thing is tracking, ID verification, constant social credit-like ratings, etc. That's what is coming.
Do you mean things like masked armed federal agents demanding to see your proof of citizenship or they'll lock you up (or sometimes just locking you up anyway)? Is that what's coming? Is that what you're afraid of? Or is that fine if it only happens to people you don't agree with?
These talking points, as always, are fearmongering designed to trigger paranoia in people so that they'll go along with whatever the people in charge say will fix things. No one on the left has proposed any of these things, but people on the right are constantly saying that's whats coming because it's what helps them keep their base frightened and compliant, and you've fallen for it (or are part of it, I don't know).
If you want to discredit an imagine, upload a slightly ai-edited copy of it.
Now Nancy, a tech-phobic waitress who has a grudge against her coworker can make up an entire scenario with one prompt and her colleagues might blindly believe her.
Let's not pretend they're the same thing.
Gen AI is inevitable. Watermarking is likely futile. But in my opinion it is still very important to discuss how, as a society, we're going to live in a post-truth world now that anybody can, IN SECONDS, not only fabricate a story but also spread it to thousands of people through their social media.
"Don't trust what you see on the Internet. Trust instead what you read in a reputable daily newspaper, or Peter Jennings or Tom Brokaw on the nightly news, or BBC World News."
Today, the Internet, especially the part which is not trustable, has nearly finished killing most of the "trustworthy" news sources, by outcompeting them for ad dollars - by being way better at targeting ads (e.g. Meta) and by scientifically perfecting addiction (e.g. TikTok). What remains is mostly controlled by governments and has far from a perfect record of being fact-based and impartial.[1] There are a ton of independent people out there in good faith posting facts on the Internet, but we just agreed that we shouldn't trust what we see on the Internet.
So doesn't this become "Don't trust anything"? And doesn't that, in practice, get implemented as "Don't trust anything that challenges what you believe to be true"? This feels like a really, really bad change to our society - and I'd argue it's already completely happened.
[1] https://apnews.com/article/bbc-gaza-documentary-hamas-sancti...
[1] https://news.gallup.com/poll/695762/trust-media-new-low.aspx
[2] https://www.businessinsider.com/these-6-corporations-control...
Which independent journalists do you like?
I have no objection to this -- I follow a few that I would say meet that definition well and which I trust. But boy do I worry that for 90% of the population, this translates to picking a bunch of enthusiastic propagandists whose bias is far worse than MSNBC, Fox News, or CNN ever were. I assume our craven and corrupt political parties will increasingly focus on propping up "independent journalists" who repeat their talking points for them.
Effective democracy requires an informed voter base. Society requires its constituents to be invested in its continuity. Neither of those is achievable when we completely discard trust.
AI kind of makes this worse, but also only barely. Because most people really ought to know by now that almost any content could be AI, a video of, say, Trump kicking a baby or violating a goat wouldn't convince anyone that those acts happened (unless they already believed they happened).
Thing is, we're so flooded in biased BS, and no one has any incentive to produce non-sensational, factual news. I absolutely see 'post-truth' as the inevitability. You can't "weed a garden" when it is 100% weeds. The term "news" will cease to mean facts, and just become a branch of entertainment. Kind of the way "Reality TV" went from being supposedly a documentary (e.g. COPS) to just being a flavor of entertainment, where nothing needs to be real.
Do you want to make it easier for the next Stalin?
In reality, all images will cease to be trustworthy and there's nothing that can be done about this.
Drugs are banned, they still exist. Many torrents flourish (that violate copyright laws), humans can't seem to stop those.
Generative AI has too much commercial utility to ever be "snatched back" at this point through legislative means.
> It's kind of a big problem for the future of the justice system and politics.
People will adapt, but this "big problem" is going nowhere.
We already have the problem of people blindly trusting shit they read on the Internet.
This sort of solution to the fake image problem, makes it easier for stalin not harder. If everyone can make fake images that is one thing. If only the dictator can, well that is much worse.