News for hackers. Stuff that matters.
Re:Slaughterbots: Stop Autonomous Weapons [video] by jrochkind1 on Sunday November 19, 2017 @02:55AM (#15732822)
We can make it considered unacceptable and against international law. Like chemical weapons. Which still happen, but not as much as they would if the U.S were, say, planning on using them all over the place, doing heavy R&D into them, and selling them to other people. Like, you know, robot kill bots.
Re:Slaughterbots: Stop Autonomous Weapons [video] by mikeash on Sunday November 19, 2017 @09:52AM (#15734100)
Most of the reason chemical weapons don't get used is because they're not very effective. It's hard to disperse them on the battlefield, changing weather has a nasty habit of blowing the stuff back onto your own troops, and protective gear is cheap enough to equip everyone in an army. I'm pretty sure that everyone was willing to ban them internationally not just because they're horrible but also because they're not very useful.

Compare with nuclear weapons, which are way worse and have a lot of support for a ban, but there's no serious hope of that ever happening, because they are really good at killing people and destroying stuff.

Seems to me that a ban is only realistic if the stuff doesn't work well.

Re:Slaughterbots: Stop Autonomous Weapons [video] by YeGoblynQueenne on Sunday November 19, 2017 @12:14PM (#15734719)
>> Most of the reason chemical weapons don't get used is because they're not very effective.

Against a modern military equipped and prepared to withstand them, perhaps. Against a civilian population or a less well-funded force, not so much. This is doubly the case when the attacker is a non-state agent (like a terrorist). Remember for instance the Sarin gas attack in the Tokyo metro by the Shinning Path [1]. An air force bombing a major city with chemical weapons would also cause vast casualties.

I think what you're trying to say is that chemical weapons are primarily designed to be terrifying with lethality considerations coming next. However, you could argue the same about nuclear weapons. After all, the attacks in Hiroshima and Nagasaki were not acutally meant to wipe the Japanese apart, only to scare them into submission. And nuclear deterrence works on the principle that an enemy won't dare attack a nuclear power.

In general, you could think of all weapons ever as aimed primarily at the morale of the enemy rather than their life and that thought may have some merit. After all, an army that breaks and runs is beaten faster and with fewer losses to the other side than one that fights to the last [2].

However, the important point to keep in mind is that weapons, even when they're primarily designed to be terrifying, are designed to be terrifying in the manner they kill. So I think you'll find that most people would agree that chemical weapons should be banned because they kill in a horrible manner, not relative to the number of casualties they may or may not inflict.

I do think you underestimate their potency btw.

__________________________

[1] https://en.wikipedia.org/wiki/Tokyo_subway_sarin_attack

[2] Cough cough. In war games, certainly.

Re:Slaughterbots: Stop Autonomous Weapons [video] by robotresearcher on Sunday November 19, 2017 @12:35PM (#15734852)
It’s already against the law to murder people.
Re:Slaughterbots: Stop Autonomous Weapons [video] by jrochkind1 on Monday November 20, 2017 @12:14AM (#15737970)
It's not in fact against international law or the laws of war to kill people, cause, you know, war.

I guess you could think if we can't just get rid of war (which is always terrible), there's no reason to have international laws and agreements limiting certain kinds of killing and other harm as off limits and unacceptable.

Apparently our current leaders agree with you.

Re:Slaughterbots: Stop Autonomous Weapons [video] by robotresearcher on Monday November 20, 2017 @03:26AM (#15738585)
I deliberately used the word 'murder', not 'kill'.

The position of the Canadian government is that the development of autonomous weapons is already illegal under Article 36 of the 1977 Extended Protocol 1 to the Geneva Convention of 1949.

Re:Slaughterbots: Stop Autonomous Weapons [video] by nradov on Sunday November 19, 2017 @06:37AM (#15733458)
How would you write such a treaty? Limit the CPU speed of weapons systems or something? Totally unenforceable.
Re:Slaughterbots: Stop Autonomous Weapons [video] by jononor on Sunday November 19, 2017 @06:55AM (#15733521)
Could forbid weapons to take kill actions themselves, each instance having to be activated by a human operator.

Could also forbid self-replication of weaponized robots.

Re:Slaughterbots: Stop Autonomous Weapons [video] by jstanley on Sunday November 19, 2017 @10:52AM (#15734351)
Why not go one step further and say that nobody is allowed to take a kill action? Killing is murder.

Not sarcastic.

Re:Slaughterbots: Stop Autonomous Weapons [video] by nine_k on Sunday November 19, 2017 @10:17PM (#15737502)
The first force to break the rule will prevail.

Pacifism is an unstable configuration; non-aggression is.

Re:Slaughterbots: Stop Autonomous Weapons [video] by Joeri on Sunday November 19, 2017 @08:54AM (#15733885)
If you deploy automated drone factories that send out millions of these things, and then have an army of people all pressing "kill" buttons as if they were doing a quick-fire arcade game, without even seeing what they were killing, it would comply with the rules you describe.
Re:Slaughterbots: Stop Autonomous Weapons [video] by yorwba on Sunday November 19, 2017 @09:27AM (#15734005)
Those rules would be enforced by humans, and humans don't tend to be very impressed by attempts to follow the letter of the law while violating its spirit.

Laws as written have all kinds of obvious loopholes, but they are intentionally vague enough that a judge can look at your "obvious loophole" and decide that you are in violation anyway.

Re:Slaughterbots: Stop Autonomous Weapons [video] by gaius on Sunday November 19, 2017 @09:54AM (#15734112)
hose rules would be enforced by humans, and humans don't tend to be very impressed by attempts to follow the letter of the law while violating its spirit.

That Google, Apple, Uber et al pay so very little tax suggests that that is an optimistic appraisal.

Re:Slaughterbots: Stop Autonomous Weapons [video] by jononor on Sunday November 19, 2017 @09:33AM (#15734026)
Sure. At least it cannot be done without the active participation of humans. Who hat least may object, though there are many ways to attempt to avoid that from happening. One being deluding them into thinking it is just a game.
Re:Slaughterbots: Stop Autonomous Weapons [video] by rqs on Sunday November 19, 2017 @09:02AM (#15733913)
Do you still remember The Three Laws of Robotics[0]? Not too many people still mentions it now days.

Killing AI is not the same problem with nuclear weapon. Because AI weapon is far easier to make compare to nuclear one. Technically, you can do it right now with your DJI drone, all it takes is just to program it to do some automatic control.

So I'm not quite optimistic about any attempt on limit those kind of weapons base on current condition we are in.

[0] https://www.auburn.edu/~vestmon/robotics.html

Re:Slaughterbots: Stop Autonomous Weapons [video] by robotresearcher on Sunday November 19, 2017 @12:38PM (#15734879)
The three laws are a literary device, not a serious engineering proposal. The stories they were introduced in described exactly why they have such serious problems.
Re:Slaughterbots: Stop Autonomous Weapons [video] by rqs on Sunday November 19, 2017 @09:37PM (#15737366)
> they were introduced in described exactly why they have such serious problems.

Yet, people stopped mentioning this kind of warning even it was already there for way over half of a century.

Reason of we successfully limited use of nuclear weapon is because, well, the US tested it on Japanese, saw the devastating result and thinking "What if the Japanese (Or Russian, Chinese etc) one day use it on us?".

I would guess only similar event can trigger everyone on earth stand in line and effectively ban those AI weapons all together. That's AFTER we all actually be seriously hurt by it.

It's just like the warning of globe warming, the math is there, proved by observation, somebody out there still believe we will be fine because the whole globe warming thing is just a conspiracy made by China.

Re:Slaughterbots: Stop Autonomous Weapons [video] by nradov on Sunday November 19, 2017 @05:23PM (#15736287)
Such weapons have existed for a long time already and there's no practical way to write a legally enforceable treaty banning them. Do you really think that Russia or China would ever allow the USA to audit the source code in their weapons systems? It's ludicrous.
Re:Slaughterbots: Stop Autonomous Weapons [video] by qbrass on Sunday November 19, 2017 @07:29AM (#15733606)
So you didn't bother trying to bypass your own rules without breaking them?
Re:Slaughterbots: Stop Autonomous Weapons [video] by tomjen3 on Sunday November 19, 2017 @04:29AM (#15733059)
The difference is that I can make almost all the components of a killer bot in my living room, and the rest with of the shelf components and access to a maker space with tools.
Re:Slaughterbots: Stop Autonomous Weapons [video] by bufferoverflow on Sunday November 19, 2017 @04:43AM (#15733098)
You can make a chemical weapon too, your local hardware store has enough hazardous chemicals.

We're only safe, because crazy or truly evil people are rare.

Re:Slaughterbots: Stop Autonomous Weapons [video] by gaius on Sunday November 19, 2017 @09:51AM (#15734094)
Yes and no. The traditional barrier-to-entry for homemade chemical weapons or explosives is that the wannabe terrorist usually ends up killing themselves. That doesn't necessarily hold with drones, depending on what the payload is. You might not even need a payload if your plan is just to ram an airliner. So the threat of drones is much higher than "conventional" terrorism IMO.