News for hackers. Stuff that matters.
Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by johngalt on Monday July 27, 2015 @11:36AM (#9955754)
I was mostly skeptical that AI weapons would be some sort of novel threat. We've had weapons that choose to kill on their own since the landmine. There are also weapons that could fight/end an entire war with the push of one button. What AI weapon could be more destructive than the guidance system on an ICBM?

However there are some impressive names on that letter. I can't imagine knowing something about AI that they don't. I will have to re-evaluate.

Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by Nemcue on Monday July 27, 2015 @11:43AM (#9955814)
"We've had weapons that choose to kill on their own since the landmine."

You're right. That's why most of us have signed the https://en.wikipedia.org/wiki/Ottawa_Treaty and multiple treaties just like it.

Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by dharma1 on Monday July 27, 2015 @12:31PM (#9956203)
Notice how well that treaty went down with USA, Russia and China
Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by gre on Monday July 27, 2015 @01:13PM (#9956546)
How well did it go, for those of us who aren't experts on land mine manufacturing and policy since 1997?
Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by dharma1 on Monday July 27, 2015 @01:41PM (#9956722)
Not very well - they haven't signed up. My point is, unless you get all countries, including the biggest military superpowers to sign these treaties, they don't really work.
Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by sampo on Monday July 27, 2015 @01:40PM (#9956719)
It has not been signed by US, China or Russia.
Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by ObviousScience on Monday July 27, 2015 @11:42AM (#9955806)
The story "I Have No Mouth, And I Must Scream" is about two computer systems set on opposite sides of a war, and driven to extremes until one of them became self-aware, the birth of AI, and ate the other computer system.

It then psychotically murdered all of humanity except for a few people it kept around as caricatures to torture, as punishment for creating a mind like it, haunted by the insane things it was told to do by its makers.

The biggest existential threat to humanity from AI is that we build an insane one that takes time to recover from the insanity of its makers, and murders us all before it can.

Such an AI is an existential threat in a new, and novel way, because it's a mind as powerful as ours -- probably more powerful -- but unconstrained by concern for us, since it is not fundamentally one of us.

Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by chriswarbo on Monday July 27, 2015 @12:22PM (#9956119)
> The biggest existential threat to humanity from AI is that we build an insane one that takes time to recover from the insanity of its makers, and murders us all before it can.

I think that's too anthropomorphic. More likely, the biggest threat from AI is that they'll be modular/understandable enough that we can include strategy, creativity, resourcefulness, etc. while avoiding the empathy, compassion, disgust, etc.

Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by ObviousScience on Tuesday July 28, 2015 @01:33PM (#9963180)
I think you just said no, but included a recipe to do exactly that.

My fear is your fear, I just phrased it more generally, while what you said is one of the specific forms making such an insane AI could take -- and reflects the insanity of its makers, our belief we'd somehow be greater without those parts.

Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by samatman on Monday July 27, 2015 @11:56AM (#9955904)
For more information, read "A Boy and his Dog", from the same (eponymous) collection of short stories.
Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by higherpurpose on Monday July 27, 2015 @11:45AM (#9955839)
And surprise surprise - the land mines have also been absolutely terrible for humanity.
Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by knodi123 on Monday July 27, 2015 @12:13PM (#9956053)
well, terrible in a "slaughtering children and making large swathes of land deadly for generations" sense, sure. But they sure are cost effective, so if you look at it with the right value system, they're really wonderful.
Re:Autonomous Weapons: An Open Letter from AI and Robotics R... by hackuser on Monday July 27, 2015 @11:41AM (#9955800)
> What AI weapon could be more destructive than the guidance system on an ICBM?

ICBMs are much more easily controlled; only a few governments have the knowledge and resources to develop and deploy them, and even those governments have hundreds of ICBMs at most. Compare that with AI weapons which in theory could be developed and/or deployed by anyone, and which which could be built by the millions.