News for hackers. Stuff that matters.

A comment on Pause Giant AI Experiments: An Open Letter. Parent comment

Re:Pause Giant AI Experiments: An Open Letter by chasd00 on Thursday March 30, 2023 @09:45AM (#35372617)
The risk is relying on AI to give a human information on whether or not to push the button and the AI gets it wrong but communicates so effectively the human trusts it without question.

An AI learning about and then executing a social engineering attack on a human (whether with malicious intent or not) seems like a reasonable thign to be worried about to me.

[ Parent | on HN ]
Re:Pause Giant AI Experiments: An Open Letter by nradov on Thursday March 30, 2023 @10:17AM (#35373059)
Initiating a nuclear strike requires sending authentication codes via designated secure channels. No matter how good some hypothetical future AI gets at impersonating President Biden, it won't be able to ring up the duty officer at Minot Air Force Base and order them to nuke Moscow. Don't believe what you see in the movies.
[ Parent | on HN ]
Re:Pause Giant AI Experiments: An Open Letter by felipemnoa on Thursday March 30, 2023 @11:00AM (#35373662)
I don't know, I'm pretty sure some future AI is up for the challenge. I can almost picture an AI telling another AI, hold my beer...
[ Parent | on HN ]
Re:Pause Giant AI Experiments: An Open Letter by ImPostingOnHN on Thursday March 30, 2023 @05:04PM (#35378803)
imagine instead just making it look like someone is attacking you

such incidents stemming from human error have already gotten us close to responding with force

[ Parent | on HN ]