News for hackers. Stuff that matters.
Re:Slaughterbots: Stop Autonomous Weapons [video] by neuro_imager on Saturday November 18, 2017 @11:38PM (#15732290)
Unfortunately I don't see a way this can be avoided.There has never been a weapon humanity imagined, designed, and built that it has not used. AI will be no different.

A ban would be impossible to implement. What exactly would you ban? AI? Drones? facial recognition? Once you have a certain level of capability in these technologies, weaponising these things is the easy part.

Re:Slaughterbots: Stop Autonomous Weapons [video] by jrochkind1 on Sunday November 19, 2017 @02:55AM (#15732822)
We can make it considered unacceptable and against international law. Like chemical weapons. Which still happen, but not as much as they would if the U.S were, say, planning on using them all over the place, doing heavy R&D into them, and selling them to other people. Like, you know, robot kill bots.
Re:Slaughterbots: Stop Autonomous Weapons [video] by mikeash on Sunday November 19, 2017 @09:52AM (#15734100)
Most of the reason chemical weapons don't get used is because they're not very effective. It's hard to disperse them on the battlefield, changing weather has a nasty habit of blowing the stuff back onto your own troops, and protective gear is cheap enough to equip everyone in an army. I'm pretty sure that everyone was willing to ban them internationally not just because they're horrible but also because they're not very useful.

Compare with nuclear weapons, which are way worse and have a lot of support for a ban, but there's no serious hope of that ever happening, because they are really good at killing people and destroying stuff.

Seems to me that a ban is only realistic if the stuff doesn't work well.

Re:Slaughterbots: Stop Autonomous Weapons [video] by YeGoblynQueenne on Sunday November 19, 2017 @12:14PM (#15734719)
>> Most of the reason chemical weapons don't get used is because they're not very effective.

Against a modern military equipped and prepared to withstand them, perhaps. Against a civilian population or a less well-funded force, not so much. This is doubly the case when the attacker is a non-state agent (like a terrorist). Remember for instance the Sarin gas attack in the Tokyo metro by the Shinning Path [1]. An air force bombing a major city with chemical weapons would also cause vast casualties.

I think what you're trying to say is that chemical weapons are primarily designed to be terrifying with lethality considerations coming next. However, you could argue the same about nuclear weapons. After all, the attacks in Hiroshima and Nagasaki were not acutally meant to wipe the Japanese apart, only to scare them into submission. And nuclear deterrence works on the principle that an enemy won't dare attack a nuclear power.

In general, you could think of all weapons ever as aimed primarily at the morale of the enemy rather than their life and that thought may have some merit. After all, an army that breaks and runs is beaten faster and with fewer losses to the other side than one that fights to the last [2].

However, the important point to keep in mind is that weapons, even when they're primarily designed to be terrifying, are designed to be terrifying in the manner they kill. So I think you'll find that most people would agree that chemical weapons should be banned because they kill in a horrible manner, not relative to the number of casualties they may or may not inflict.

I do think you underestimate their potency btw.

__________________________

[1] https://en.wikipedia.org/wiki/Tokyo_subway_sarin_attack

[2] Cough cough. In war games, certainly.

Re:Slaughterbots: Stop Autonomous Weapons [video] by robotresearcher on Sunday November 19, 2017 @12:35PM (#15734852)
It’s already against the law to murder people.
Re:Slaughterbots: Stop Autonomous Weapons [video] by jrochkind1 on Monday November 20, 2017 @12:14AM (#15737970)
It's not in fact against international law or the laws of war to kill people, cause, you know, war.

I guess you could think if we can't just get rid of war (which is always terrible), there's no reason to have international laws and agreements limiting certain kinds of killing and other harm as off limits and unacceptable.

Apparently our current leaders agree with you.

Re:Slaughterbots: Stop Autonomous Weapons [video] by robotresearcher on Monday November 20, 2017 @03:26AM (#15738585)
I deliberately used the word 'murder', not 'kill'.

The position of the Canadian government is that the development of autonomous weapons is already illegal under Article 36 of the 1977 Extended Protocol 1 to the Geneva Convention of 1949.

Re:Slaughterbots: Stop Autonomous Weapons [video] by nradov on Sunday November 19, 2017 @06:37AM (#15733458)
How would you write such a treaty? Limit the CPU speed of weapons systems or something? Totally unenforceable.
Re:Slaughterbots: Stop Autonomous Weapons [video] by jononor on Sunday November 19, 2017 @06:55AM (#15733521)
Could forbid weapons to take kill actions themselves, each instance having to be activated by a human operator.

Could also forbid self-replication of weaponized robots.

Re:Slaughterbots: Stop Autonomous Weapons [video] by jstanley on Sunday November 19, 2017 @10:52AM (#15734351)
Why not go one step further and say that nobody is allowed to take a kill action? Killing is murder.

Not sarcastic.

Re:Slaughterbots: Stop Autonomous Weapons [video] by nine_k on Sunday November 19, 2017 @10:17PM (#15737502)
The first force to break the rule will prevail.

Pacifism is an unstable configuration; non-aggression is.

Re:Slaughterbots: Stop Autonomous Weapons [video] by Joeri on Sunday November 19, 2017 @08:54AM (#15733885)
If you deploy automated drone factories that send out millions of these things, and then have an army of people all pressing "kill" buttons as if they were doing a quick-fire arcade game, without even seeing what they were killing, it would comply with the rules you describe.
Re:Slaughterbots: Stop Autonomous Weapons [video] by yorwba on Sunday November 19, 2017 @09:27AM (#15734005)
Those rules would be enforced by humans, and humans don't tend to be very impressed by attempts to follow the letter of the law while violating its spirit.

Laws as written have all kinds of obvious loopholes, but they are intentionally vague enough that a judge can look at your "obvious loophole" and decide that you are in violation anyway.

Re:Slaughterbots: Stop Autonomous Weapons [video] by gaius on Sunday November 19, 2017 @09:54AM (#15734112)
hose rules would be enforced by humans, and humans don't tend to be very impressed by attempts to follow the letter of the law while violating its spirit.

That Google, Apple, Uber et al pay so very little tax suggests that that is an optimistic appraisal.

Re:Slaughterbots: Stop Autonomous Weapons [video] by jononor on Sunday November 19, 2017 @09:33AM (#15734026)
Sure. At least it cannot be done without the active participation of humans. Who hat least may object, though there are many ways to attempt to avoid that from happening. One being deluding them into thinking it is just a game.
Re:Slaughterbots: Stop Autonomous Weapons [video] by rqs on Sunday November 19, 2017 @09:02AM (#15733913)
Do you still remember The Three Laws of Robotics[0]? Not too many people still mentions it now days.

Killing AI is not the same problem with nuclear weapon. Because AI weapon is far easier to make compare to nuclear one. Technically, you can do it right now with your DJI drone, all it takes is just to program it to do some automatic control.

So I'm not quite optimistic about any attempt on limit those kind of weapons base on current condition we are in.

[0] https://www.auburn.edu/~vestmon/robotics.html

Re:Slaughterbots: Stop Autonomous Weapons [video] by robotresearcher on Sunday November 19, 2017 @12:38PM (#15734879)
The three laws are a literary device, not a serious engineering proposal. The stories they were introduced in described exactly why they have such serious problems.
Re:Slaughterbots: Stop Autonomous Weapons [video] by rqs on Sunday November 19, 2017 @09:37PM (#15737366)
> they were introduced in described exactly why they have such serious problems.

Yet, people stopped mentioning this kind of warning even it was already there for way over half of a century.

Reason of we successfully limited use of nuclear weapon is because, well, the US tested it on Japanese, saw the devastating result and thinking "What if the Japanese (Or Russian, Chinese etc) one day use it on us?".

I would guess only similar event can trigger everyone on earth stand in line and effectively ban those AI weapons all together. That's AFTER we all actually be seriously hurt by it.

It's just like the warning of globe warming, the math is there, proved by observation, somebody out there still believe we will be fine because the whole globe warming thing is just a conspiracy made by China.

Re:Slaughterbots: Stop Autonomous Weapons [video] by nradov on Sunday November 19, 2017 @05:23PM (#15736287)
Such weapons have existed for a long time already and there's no practical way to write a legally enforceable treaty banning them. Do you really think that Russia or China would ever allow the USA to audit the source code in their weapons systems? It's ludicrous.
Re:Slaughterbots: Stop Autonomous Weapons [video] by qbrass on Sunday November 19, 2017 @07:29AM (#15733606)
So you didn't bother trying to bypass your own rules without breaking them?
Re:Slaughterbots: Stop Autonomous Weapons [video] by tomjen3 on Sunday November 19, 2017 @04:29AM (#15733059)
The difference is that I can make almost all the components of a killer bot in my living room, and the rest with of the shelf components and access to a maker space with tools.
Re:Slaughterbots: Stop Autonomous Weapons [video] by bufferoverflow on Sunday November 19, 2017 @04:43AM (#15733098)
You can make a chemical weapon too, your local hardware store has enough hazardous chemicals.

We're only safe, because crazy or truly evil people are rare.

Re:Slaughterbots: Stop Autonomous Weapons [video] by gaius on Sunday November 19, 2017 @09:51AM (#15734094)
Yes and no. The traditional barrier-to-entry for homemade chemical weapons or explosives is that the wannabe terrorist usually ends up killing themselves. That doesn't necessarily hold with drones, depending on what the payload is. You might not even need a payload if your plan is just to ram an airliner. So the threat of drones is much higher than "conventional" terrorism IMO.
Re:Slaughterbots: Stop Autonomous Weapons [video] by Santosh83 on Sunday November 19, 2017 @05:19AM (#15733214)
It doesn't have to be implemented 100%. Nothing is. But that doesn't stop us from banning bio & chemical weapons.

War should be approximately 'human-magnitude' in scale and proportion, or it will simply wipe us out. That's why we have built but not yet routinely used, nuclear weapons. The same strategy needs to be followed for any tech that is far more efficient and autonomous than a human would be.

Re:Slaughterbots: Stop Autonomous Weapons [video] by erasemus on Sunday November 19, 2017 @04:46AM (#15733104)
I would guess: we ban civilian drones from carrying explosives, nerve-toxins and other weapons; we invest the bulk of research effort in developing anti-drone drones. The anti-drone drones don't carry weapons that can be used against humans. Advanced drone tech would be less like nuclear weapons, against which there is no defence, and more like vaccines or antidotes.

Which is morally very different. Actually morality is an interesting aspect of the video/story. We had the bad guy white male presenter on the stage playing the good guy and claiming that his weapons could distinguish good guys from bad guys (and then of course the targeting of said weapons with a pitifully inadequate and unrealistic set of criteria).

Re:Slaughterbots: Stop Autonomous Weapons [video] by partycoder on Sunday November 19, 2017 @05:16AM (#15733206)
You can make any laws. But how exactly do you enforce them?

Civilians manufacture and own drones, 3d printers are consumer products now, there are incredibly affordable electronic kits (e.g: Raspberry Pi)... then, for computer vision and AI you've got a lot of free toolkits to pick from... it will be challenging to effectively prevent it even if legislation forbids it.

Re:Slaughterbots: Stop Autonomous Weapons [video] by erasemus on Sunday November 19, 2017 @05:56AM (#15733341)
The bulk of the effort goes into R&D for anti-drone tech (this includes monitoring what the bad guys are up to).
Re:Slaughterbots: Stop Autonomous Weapons [video] by Jach on Sunday November 19, 2017 @04:10AM (#15733001)
I think the proposed ban is: don't develop weapons with software that can make the killing decisions without humans in the loop. That itself isn't so impossible a ban to make something like the CWC out of, but nations couldn't even stop 3D gun printing, despite the same sort of worries.

Additionally, even with that ban, you could have the exact same video with the minor difference that each drone sends its video stream to a human somewhere else who presses a button to authorize each suggested-by-the-drone kill. And if we got that far, the pressure to get rid of the ban would be immense, because tool AIs are better as agent AIs.

And if we can't even handle regular old microsystems technology, how are we going to handle nanotech? https://www.amazon.com/Military-Nanotechnology-Applications-... (and briefly covered in this talk by the same author http://www.youtube.com/watch?v=MANPyybo-dA) discusses it but in the 11 years since it was published I see no reason to think the world is any better prepared.

Re:Slaughterbots: Stop Autonomous Weapons [video] by nradov on Sunday November 19, 2017 @06:41AM (#15733473)
Weapons that make killing decisions without humans in the loop have existed for a long time. For example captor naval mines that sit tethered in place and then launch a torpedo when they detect a vessel nearby. Those aren't going away.
Re:Slaughterbots: Stop Autonomous Weapons [video] by bufferoverflow on Sunday November 19, 2017 @04:39AM (#15733084)
You can't really ban software. Sooner or later someone will write it, opensource it, and it will be on GitHub/piratebay.
Re:Slaughterbots: Stop Autonomous Weapons [video] by soVeryTired on Sunday November 19, 2017 @06:01AM (#15733359)
It's probably impossible to stop someone weaponising a drone and piloting it with AI. But you can control how well the result is executed.

If a computer scientist teamed up with an engineer and a chemist they could probably jerry rig something that would work. Sort of. But if Northrop Grumman tried to build these things with a billion dollar budget behind them, they might actually succeed in replicating the drones in the video.

Re:Slaughterbots: Stop Autonomous Weapons [video] by vadimberman on Sunday November 19, 2017 @12:20AM (#15732404)
> There has never been a weapon humanity imagined, designed, and built that it has not used.

What about the neutron bomb?

But overall, yes, I agree, a rifle hanging on the wall will eventually go off.

Re:Slaughterbots: Stop Autonomous Weapons [video] by mikeash on Sunday November 19, 2017 @09:54AM (#15734107)
A neutron bomb isn't really a separate thing, it's just a nuclear weapon designed for more radiation and less blast. And of course nuclear bombs have been used in war.
Re:Slaughterbots: Stop Autonomous Weapons [video] by tehlike on Sunday November 19, 2017 @12:41AM (#15732455)
Matter of time.
Re:Slaughterbots: Stop Autonomous Weapons [video] by zachrose on Sunday November 19, 2017 @12:52AM (#15732482)
This is a temporal version of the No True Scotsman fallacy.
Re:Slaughterbots: Stop Autonomous Weapons [video] by reificator on Sunday November 19, 2017 @02:20AM (#15732721)
The "No Temporal Scotsman" fallacy if you will.
Re:Slaughterbots: Stop Autonomous Weapons [video] by aoeuasdf1 on Sunday November 19, 2017 @05:19AM (#15733213)
The "Non-Timely Scotsman" fallacy?
Re:Slaughterbots: Stop Autonomous Weapons [video] by afarrell on Sunday November 19, 2017 @05:45AM (#15733314)
Outlander fans will be very sad.
Re:Slaughterbots: Stop Autonomous Weapons [video] by YeGoblynQueenne on Sunday November 19, 2017 @11:57AM (#15734620)
There's only ever been two nuclear strikes however. Nations do have nuclear arsenals but have, so far, not been stupid enough to use them. Chemical and biological weapons are also largely banned from use.

I'm not saying that we can rest assured that we won't all end up as mushroom cloud dust someday in the maybe not distant future. But attempts to curtail the use of really dangerous weapons have paid off in the past. There's no reason why they wouldn't in this case also.

Re:Slaughterbots: Stop Autonomous Weapons [video] by speedplane on Sunday November 19, 2017 @03:21AM (#15732874)
> Unfortunately I don't see a way this can be avoided.There has never been a weapon humanity imagined, designed, and built that it has not used. AI will be no different.

Agreed history does not bode well, but it is certainly possible. Communication, treaties, non-violent methods of solving disputes can together prevent this nightmare scenario. Just because it isn't easy doesn't mean we should all throw up our hands and say it's impossible.

Re:Slaughterbots: Stop Autonomous Weapons [video] by hans_mueller on Sunday November 19, 2017 @06:14AM (#15733392)
a hydrogen bomb has never been used.
Re:Slaughterbots: Stop Autonomous Weapons [video] by arca_vorago on Sunday November 19, 2017 @11:26AM (#15734487)
I stand by my right to a robot army as self-defense in the mean time while I work on achieving the singularity in order to defeat skynet.