News for hackers. Stuff that matters.
Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by sys32768 on Monday October 17, 2022 @01:18PM (#33236718)
Not sure I want to live in a world where billions of people still believe what they see when these deepfake technologies mature.

Not sure I will care either, because by that time I will have been locked in my living room for weeks playing my customized VR role playing game where Han Solo and I wreak havoc in the Far Cry 5 universe with my Dovakin powers while being chased by a all-female bounty hunter crew commanded by a 1982 Phoebe Cates.

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by nomel on Monday October 17, 2022 @01:35PM (#33237004)
This is why I think it’s irresponsible to not give the public access to these early models. I think a slow, increasing, exposure to the absurd/false will work out much better than the isolation desired by the orgs who are trying to “protect” us, because that isolation will end up being temporary, resulting in a step rather than a ramp.
Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by _0ffh on Monday October 17, 2022 @02:13PM (#33237530)
Right, the earlier the general public is confronted with these technologies, the better!
Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by usednet on Monday October 17, 2022 @02:19PM (#33237600)
There needs to be far more criticism of the increasingly closed development of these models in what is essentially becoming an AI arms race. Like Sam Altman and his team at OpenAI (more like ClosedAI) who were more aware of this than anybody yet sold themselves out for the highest bidder. What a joke of a “non-profit.”
Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by tnel77 on Monday October 17, 2022 @09:02PM (#33241734)
I’m just jealous that I’m not able to sell out.
Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by BoorishBears on Monday October 17, 2022 @02:13PM (#33237534)
It's so bizarre to me how much commentary I see to this effect, do people forget the times we live in?

You can fool more people with a fake article and $1000 in Twitter click farm spend than you could ever dream to with a deepfake.

Like we've already seen entire elections undermined with basic internet trolling, the problem is already here, but somehow people are overlooking that and fixated on the most fanciful version of it?

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by BizarroLand on Monday October 17, 2022 @02:26PM (#33237684)
Plus, for some reason humans as a group tend to prefer the fake perfect over the real good. Autotune perfects bad playing and singing, we use audience brain responses to tune the editing of movies, CGI over practical effects, clickbait over quality titles, zinging 1 liners more important than the novel they describe.

One the one hand, you can't fault the masses for buying the goods they're sold, and on the other hand you can't fault the sellers for maximizing the apparent quality of their products, but somewhere inbetween all of that broad mindedness and beauty there has to be something at fault for creating a world where actual human beings are not good enough to participate as equals and the playing field is pay to win on a scale that boggles the imagination.

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by authpor on Monday October 17, 2022 @02:38PM (#33237830)
I first encountered that idea as "supernormality"

https://en.wikipedia.org/wiki/Supernormal_stimulus

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by parker_mountain on Monday October 17, 2022 @03:29PM (#33238411)
> You can fool more people with a fake article and $1000 in Twitter click farm spend than you could ever dream to with a deepfake.

Strong disagree. Viral content is way more effective.

And also, imagine what you can do with $1000 in ad spend and a deepfake.

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by BoorishBears on Monday October 17, 2022 @03:51PM (#33238672)
You're not disagreeing. I didn't think I needed to connect the dots that you're paying the click farm to go viral.

> And also, imagine what you can do with $1000 in ad spend and a deepfake.

Way less. A deepfake detracts from your mission. If you deepfake Joe Biden saying "I'm going to destroy this country as instructed by my masters" and you actually gain traction, suddenly you've thrust your subversion into the spotlight and start reaching people adversarial to your goal.

News sources are going to start digging to find where the clip came from, the White House is going to respond, the video is going to start getting analyzed to death.

-

If instead you register a dime a dozen domain like "america4evernews.com" and write a crackpot article about how Joe Biden is actually working for our enemies and you have it on good authority that he's being controlled by puppet masters who want him to destroy America, you'll find an army of people who want to believe.

They don't need sources, they'll avoid sharing it with the "sheeple who believe MSM" and stick to their echo chambers. It's a strictly better outcome.

People don't seem to understand that modern misinformation is not about fooling everyone, it's about fooling the right people. You're goal isn't to reach every set of eyeballs, it's to reach the eyeballs that are easily fooled so that they come in conflict with those who are not, thus entrenching both sides against each other.

-

In some ways it's like a virus: if it's too strong it draws attention to itself early and can't spread easily. If instead it causes subtle symptoms that compound, it can spread very widely before it's even noticed, and use that infected base to expand even further.

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by callalex on Monday October 17, 2022 @03:55PM (#33238731)
My thought process: if spreading disinformation without evidence is so successful right now, imagine how much worse things could be in the future when people are spreading disinformation with “evidence”.
Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by BoorishBears on Monday October 17, 2022 @04:12PM (#33238939)
I have a comment below about it, evidence is actually contrary to the goal.

If you bring evidence you're introducing a place for a counter attack to apply leverage.

If instead you make completely baseless claims on obvious false pretenses, you've actually made things more difficult to counter because only trivial counterproofs exist, which have to be dismissed to believe the false claim in the first place.

-

Take COVID vaccine deaths for example. Imagine I completely baselessly say that the medical field is lying and 50% of COVID deaths are actually vaccine complications.

For someone to believe that, they must completely distrust any official numbers on COVID deaths... so once they've fallen for the lie, how do you convince them otherwise? The only counterproofs are the trivial to find sources of data that they already had to dismiss to believe me in the first place. Suddenly I've implanted a self-enforcing lie that entrenches its believers against anyone who isn't in their echo chamber.

The root of all this is straightfoward enough: there is nothing stronger than requiring someone to disbelieve their own beliefs to counter your disinformation. If you add a deepfake, you've added something outside of their belief system to attack, so you're weakening the attempt. People simply do not like to be wrong about things they think they've figured out.

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by LawTalkingGuy on Monday October 17, 2022 @04:33PM (#33239170)
If you used a Biden deepfake you'd more likely want it to be of him tripping on something than admitting allegiance to the lizards.

> Imagine I [...] For someone to believe that, they must completely distrust any [data]

Do you think this is this like a 419 scam where saying something a bit outrageous sorts out the gullible and bypasses the wary or do you think that your claim can somehow hijack a credulous person long enough so that they make that mental recategorization of the data sources and are stuck?

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by BoorishBears on Monday October 17, 2022 @05:40PM (#33239877)
The former gives you a springboard for the latter

The people falling for the obvious nonsense are self filtering just like people falling for obvious 419 scams.

But as you grow the base that believes in your disinformation, you gain real people who are fully convinced of these things, and the effect of that is a force multiplier.

People talk, and if people's self-held beliefs are the strongest reinforcement, the second strongest is those we surround ourselves with. If someone falls for this stuff and starts talking to the spouse, now someone close to them is pushing this agenda. People can start nudging their friends to be more skeptical.

It's not going to be a 1:1 conversion: a lot of people close to them will push back, but remember, this is all based on absolutely no proof, so it can twist itself to fit any box. People can moderate the story to avoid pushback: "Oh you know I'm not an anti-vaxxer... but I did heard that vaccine has a lot of complications", and maybe they connect that to a real article about a myocarditis case, and now maybe they're not pushing my original lie of "50% of deaths", but I've planted an suggestion in a rather moderate person using a chain of gullible people.

And something is especially effective about this is the fact that, while the most brazen aspects of disinformation hit less intelligent people hardest (https://news.ku.edu/2020/04/28/study-shows-vulnerable-popula...)

Once you start to make inroads with increasingly better educated groups via the network effect, they tend to not want to believe they're wrong. Highly intelligent people can be more susceptible to some aspects of disinformation in this way: https://www.theguardian.com/books/2019/apr/01/why-smart-peop...

That lends itself to increasingly authoritative figures becoming deeply entrenched in those campaigns, leading to things like... https://wapp.capitol.tn.gov/apps/BillInfo/Default.aspx?BillN...

-

Overall I've said this before, everyone is dreaming of AI dystopias rooted in things like deepfakes putting us in a post-truth era, or AI gaining sentience and deciding it doesn't need humans...

The reality is so much more boring, yet already in progress. We're starting to embed blackbox ML models trained on biased or flawed data into the root of society.

ML already dictates what a large number of people are exposed to via social media. ML is starting to work its way into crime fighting. We gate access to services behind ML models that are allowed to just deny us access. How long before ML is allowed to start messing with credit ratings?

And yet getting models to "explain" their reasoning is a field of study that's completely behind all of these things. You can remove race from a dataset and ML will still gladly start codifying race into its decisions via proxies like zipcodes, after all it has no concept of morality or equality: it's just a giant shredder for data.

Right now a glorified bag of linear regressions is posing much more of an effective danger than T1000s ever will. But since that's not as captivating instead we see a ton of gnashing of teeth about the ethics of general intelligence, or how we need to regulate the ability to make fake videos, rather than boring things like "let's restrict ML from as many institutional frameworks as possible"

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by janalsncm on Monday October 17, 2022 @06:24PM (#33240287)
> But since that's not as captivating instead we see a ton of gnashing of teeth about the ethics of general intelligence, or how we need to regulate the ability to make fake videos, rather than boring things like "let's restrict ML from as many institutional frameworks as possible"

It’s not only not captivating, it’s downright inconvenient. If I’m at a TED talk I don’t want to hear about how ML models (some of which my company has deployed) are causing real world harms __right now__ through automation and black box discrimination. If you read Nick Bostrom’s Superintelligence it spends laughably little time pondering the fact that AI will likely lead to a world of serfs and Trillionaires.

No, people want to hear about how we might get Terminator/Skynet in 30 years if we’re not careful. Note that these problems are already complicated by ill-defined concepts like sentience, consciousness and intelligence, the definitions of which suck all of the oxygen out of the room before practical real-world harms can be discussed.

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by Someone on Monday October 17, 2022 @07:11PM (#33240750)
Makes me think of https://en.wikipedia.org/wiki/Big_lie: the use of a lie so colossal that no one would believe that someone "could have the impudence to distort the truth so infamously."

And yes, I do not think adding a deep fake of some big shot saying or doing X would work better than just repeating the lie that they say or do X.

Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by barbazoo on Monday October 17, 2022 @11:47PM (#33242748)
It's never about what someone said. Proof of that is completely unnecessary. Everything will be internalized as long as it's from your side, no questions asked. Deep fakes won't make that much worse.
Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by antifa on Tuesday October 18, 2022 @08:15AM (#33246072)
We already have people throwing articles and YouTube videos where the title says something like "holy shit X is happening!" and everyone runs with it as if it were evidence and then if you actually read the article or watched the video the evidence is basically "actually nothing happened" or hersay alleging that X/10000 almost happened.
Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by humanistbot on Monday October 17, 2022 @05:13PM (#33239582)
Remember that video that showed Nancy Pelosi supposedly 'drunk', but it was just slowed down and pitch shifted? It was so easy to tell it was faked, but it still spread like wildfire.
Re:Nvidia’s Implicit Warping Is a Potentially Powerful Deepf... by authpor on Monday October 17, 2022 @02:37PM (#33237815)
however the story of withholding technology, education, etc, for profit (of some kind) is much older than this particular latest development.

if you ask me, this 'tradition' is the essence of imperialism (or just one amongs other techniques necessary to have an empire)