News for hackers. Stuff that matters.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by smt88 on Wednesday April 12, 2023 @12:20PM (#35542203)
I'm much more concerned about dictators than I am about scammers.

Some countries have already successfully rewritten the history of less than 30 years ago with surveillance and media control.

What will happen when they can also control all digital reality? They can invent an uprising of millions of people that never actually happened, and there will be photo, audio, and video "evidence".

AGI is scary, but it's not immediate. I think companies like OpenAI are wrecklessly pushing us toward immediate societal collapse.

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by infogulch on Wednesday April 12, 2023 @12:40PM (#35542535)
I'm also very concerned about where AI will take us, but will bad actors just quit if OpenAI decides to halt? Or will they continue to develop it, but in secret, so we have no clue what its capabilities are or how to control it? I fear the only way out is through.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by iamdamian on Wednesday April 12, 2023 @12:42PM (#35542582)
Couldn't you say this about nuclear research or bioweapons as well? Yet those are highly (and, seemingly effectively) regulated.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by PeterisP on Wednesday April 12, 2023 @01:13PM (#35543146)
No, because if you forbid the dissemination of nuclear research and materials then it's very difficult even for highly-resourced organizations (e.g. government of Iran) to produce nuclear devices, but if you would tomorrow forbid the dissemination of all future "AI research" then there are probably a million of people worldwide who would each be able to recreate the "dangerous capabilities" based on what they already have in their heads and current laptops, as long as someone gives them a few million $ worth of commodity (and thus not restrictable) computing hardware.

Nuclear technology is tricky to get working even if you have decent scientists and all the published research about basic principles. For current ML tech, a big point is that the core techniques are really simple, the simple textbook methods work at large scale, you don't necessarily need any special sauce which could be restricted. Yes, there is a lot of engineering work that goes into a full system to scale it efficiently, but all of that can be replicated by any decent bunch of engineers, unlike nuclear weapons.

The cat is out of the bag; you can't put the genie back in the bottle, all the "sensitive knowledge" you'd need to restrict AI is already known by at least a few CS undergrads in every single university in the world.

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by pl90087 on Wednesday April 12, 2023 @01:23PM (#35543332)
For nuclear research you could be right, but not so much with bioweapons. Already 20 years ago you could manufacture the polio virus from scratch just using publicly available data. https://www.science.org/content/article/poliovirus-baked-scr...
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by function_seven on Wednesday April 12, 2023 @12:50PM (#35542709)
Those can be regulated because they require a level of physical access to materials. Centrifuges and viral samples and whatnot.

A given AI, once created, is "just" data. It can be sent around the world and run on commodity hardware. Nothing special needed beyond the expertise that created it in the first place.

Think of how relatively easy it is to clamp down on bioweapons, and compare that with our ability to stop malware.

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by Retric on Wednesday April 12, 2023 @01:14PM (#35543173)
The same is largely true of bio weapons. The difficult but is R&D, but a small group with access to a decent collage lab could recreate some dangerous shit if the people using it knew what to do.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by yeck on Wednesday April 12, 2023 @01:53PM (#35543839)
Training new SOTA (state-of-the-art) models does require a large amount of compute resources. So we could at least pause here and not make more powerful models publicly available until we understand the implications of wtf actually just happened over the last 6 months.

Certainly the models and weights that have been released publicly are out in the wild and near impossible to retract. That damage is done.

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by from on Wednesday April 12, 2023 @12:50PM (#35542697)
Yes but those have higher barrier to entry, MAD dynamics and the fact that you can't clone a nuclear weapon off Github.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by iamdamian on Wednesday April 12, 2023 @08:34PM (#35549215)
Can you clone ChatGPT's weights off of GitHub?
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by ngngngng on Wednesday April 12, 2023 @12:56PM (#35542814)
What will happen when asking AI its opinion on someone is part of a background check?
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by htrp on Wednesday April 12, 2023 @01:48PM (#35543748)
probably already there
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by amelius on Wednesday April 12, 2023 @12:57PM (#35542830)
Or when a dictator can just put a camera on every corner of every street, then do fully automated data mining on how and when people are moving around.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by Micheal_McL on Wednesday April 12, 2023 @12:59PM (#35542875)
1984
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by mikrotikker on Wednesday April 12, 2023 @04:49PM (#35546651)
China, UK. Stingray.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by bawolff on Wednesday April 12, 2023 @01:01PM (#35542904)
> Some countries have already successfully rewritten the history of less than 30 years ago with surveillance and media control.

Soviet union was doing it back in the early 1900s

Even the ancient world did it https://en.wikipedia.org/wiki/Damnatio_memoriae

Yes we can fake more, but there are also more ways to get information so its harder to suppress true info. I think the two cancel each other out.

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by j16sdiz on Wednesday April 12, 2023 @01:22PM (#35543302)
They don't cancel each other. People get information overload, whatever they learnt first will win.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by smt88 on Wednesday April 12, 2023 @02:06PM (#35544079)
> Yes we can fake more...

"More" is dramatically understating it. The new platforms (GPT4, Midjourney, etc.) are able to automate the propaganda output of literally millions of people.

If you wanted someone to Photoshop the pope into multiple new outfits and fool a lot of people, you used to need at least a few hours of an expert's time. Now you can do it almost instantly.

It's many orders of magnitude faster to create highly realistic lies than it used to be.

> but there are also more ways to get information so its harder to suppress true info.

There are the same ways to get information, and they're going to be: A) unverifiable, and B) drowned out by propaganda.

Let's say someone wants to take down Joe Biden, and they generate text, audio, video, and photos of him molesting a child. Millions of people would want to believe it and then believe it. How would we prove it's not real? How could we, other than finding the person who did it or exposing a digital trail?

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by mikrotikker on Wednesday April 12, 2023 @04:48PM (#35546630)
I questioned the Dalai Llama story as a possible CCP deep fake. Considering what they already did with doctored photos of Australian soldiers a year or so back.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by jwestbury on Thursday April 13, 2023 @05:47AM (#35553141)
> Yes we can fake more, but there are also more ways to get information so its harder to suppress true info. I think the two cancel each other out.

They don't, unfortunately. The continued influence effect means that information received first will generally take priority.

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by titzer on Wednesday April 12, 2023 @01:32PM (#35543480)
> are wrecklessly pushing us toward immediate societal collapse.

I would characterize this as just adding more and more landmines to an already crowded space of potential collapse-inducing events through which have to try to navigate society. Oh, and adding glitzy blinkenlights to attract people towards those landmines. "Let the marketplace decide if landmines are fun to step on."

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by smt88 on Wednesday April 12, 2023 @02:07PM (#35544090)
Your first sentence makes it sound not that bad, and then your second sentence makes it sound like it's certainly going to be society-ending.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by titzer on Wednesday April 12, 2023 @02:57PM (#35544906)
The risks keep stacking up. It's not looking super great for avoiding all the landmines. The path is getting narrow and it's one thing or other that'll get us.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by ModernMech on Wednesday April 12, 2023 @02:10PM (#35544142)
> "Let the marketplace decide if landmines are fun to step on."

Very succinct way to explain end stage capitalism.

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by tonmoy on Wednesday April 12, 2023 @01:35PM (#35543525)
Could they already do that using actors and sets? I doubt even the poorest dictator would lack the resources to do that currently. It’s the scammers on the other hand who would benefit with cheap ability to generate fake audio/video
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by PeterisP on Wednesday April 12, 2023 @06:40PM (#35548047)
Well, no, it's not really possible to just do that using actors and sets, it would have been done during the Cold War otherwise. Up until recent advances of digital technology it wasn't really possible to have an actor convincingly fake someone else - e.g. a foreign politician - so that it's not easily detectable; this is a recent new ability (and even now you'd still want to use a good actor with a similar face shape and skill to match the body movement style in order to make a convincing deepfake).
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by layer8 on Wednesday April 12, 2023 @01:40PM (#35543599)
Photos, audio, and video are relatively new media, historically. We always had the potential problem of historical records being rewritten. People will learn to be cautious. I wouldn’t worry too much, unless and until a worldwide government becomes a dictatorship.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by pixl97 on Wednesday April 12, 2023 @01:47PM (#35543718)
> People will learn to be cautious.

looks at history of organized religion

Um, I'm not so sure about that...

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by smt88 on Wednesday April 12, 2023 @02:00PM (#35543988)
> People will learn to be cautious.

It doesn't matter if they're cautious or not. Even for real media, how can you tell it's real?

The result will be:

- there will be no way for anyone to verify any digital media, including phone calls from loved ones

- people will believe what they want to believe

We've seen the second thing happening, and it leads to fascism.

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by hef19898 on Wednesday April 12, 2023 @02:15PM (#35544228)
Funny how history rymes. The last surge of mass media, radio, conteibuted to the rise of Fascism and Natiobalsocialism. Curious to see what "AI" will bring us, and whether or not we as a species adopt quick enough to prevent the worst.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by mikrotikker on Wednesday April 12, 2023 @04:45PM (#35546588)
Then we need to arm ourselves with firearms to fight against the coming facist wave.
Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by dang on Wednesday April 12, 2023 @06:53PM (#35548166)
Could you please stop posting unsubstantive comments and/or flamebait and also please stop using HN for ideological battle (regardless of which ideology you're battling for or against)?

You've unfortunately been doing these things repeatedly, and they're not what the site is for and destroy what it is for.

If you wouldn't mind reviewing https://news.ycombinator.com/newsguidelines.html and taking the intended spirit of the site more to heart, we'd be grateful.

Re:AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve... by neganbanks on Wednesday April 12, 2023 @03:02PM (#35544990)
Yep well there are no divine mandates humanity or this society must exist.

What is the public gonna do?

Oh, I see; goto school, goto work, passively consume todo lists society foists on them to distract from exploring their individual dynamism in deference to empowering billionaires to build AI they hate.

Maybe if the masses logged off rather than blithely contribute, but you all got fiat wealth to hallucinate the conjuring of in deference to elders who don’t know you; they just been told it’s your job to prop up their past investments. Pitter patter.

Otherwise enjoy living in a figurative ouroborus pushing Altman and the like towards the mouth, yourself towards the other end, then die some day. Enjoy that strange loop!

None of them have divine authority to the resources the species relies on. They’re surrounded by meat based VHS tapes repeating the truisms the elder’s foisted upon us decades ago.