News for hackers. Stuff that matters.
Re:Scientists call for ban on lethal, autonomous robots by hannasanarion on Friday February 15, 2019 @07:03AM (#19170180)
Lethal robots are not a technology that can really be regulated by ban.

It's not like nuclear weapons, where you need a huge industrial operation with tens of thousands of high-tech centrifuges running for years before you have enough fissile material for a bomb. Even the rulebreakers, like Israel, couldn't hide the fact that they were doing it and had to rely on America's UNSC veto to save them from the consequences.

But lethal robots are a trivial step away from the current state of robotics. Hobbyists have already mounted guns on quadcopters. Tesla and Waymo have made robots that kill people accidentally. Any robot can be made a killer robot with minimal change to its software and hardware.

Re:Scientists call for ban on lethal, autonomous robots by michaelbuckbee on Friday February 15, 2019 @08:30AM (#19170724)
Sure, but we do have all sorts of laws and restrictions on chemical weapons (which you could plausibly make by pouring some of the cleaning products in your house together).

The ban isn't a flip-switch that says: "hey, no more of these", it's the start of a formal dialogue over our relationship to these new technologies and how we would like to see them used on a worldwide basis.

If a country were to opt to drop thousands of flying drones with guns onto a military base is that different than chemical weapons? a fuel air bomb? conventional explosives? sending special forces in?

Yeah, they're all different with different repercussions, long term impacts, potential civilian casualties, etc. etc.

Re:Scientists call for ban on lethal, autonomous robots by bilbo0s on Friday February 15, 2019 @10:05AM (#19171429)
Chemical, and especially biological, weapons are an order of magnitude more difficult to manufacture correctly, (ie-without killing yourself), than autonomous drones. The thought that autonomous groups like ISIS would not use autonomous drone swarms because such a terrorist attack would "break international law" really is so far beyond "fanciful" that it ventures into "humorous" territory.

I think we can pretty much count on every group with a gripe reaching for autonomous drone swarms first in the future.

Re:Scientists call for ban on lethal, autonomous robots by kazagistar on Friday February 15, 2019 @10:54AM (#19171854)
Sure, but if they can only be developed by parties who don't care for international law, they will be weaker and less effective, then they might otherwise be, and we can focus legal development efforts on countermeasures.
Re:Scientists call for ban on lethal, autonomous robots by dalbasal on Friday February 15, 2019 @10:25AM (#19171591)
Quite a lot of "banned" or restricted weapons are simple to produce: anti personnel landmines, poison gas, cluster bombs..

They do run into the problem you described. Most militaries have them. Paramilitaries and sub-state forces (even criminals) have them. They sometimes get used, even by relatively law abiding forces.

Despite all that, those treaties do significantly impact their use in various ways. Diplomatic concerns do affect choices in conflict. These treaties put a diplomatic price on the use of certain weapons. They limit trade in these weapons.

Weapons treaties are not about perfectly police able, and internally consistent rules. No rules of war are. That doesn't mean they are entirely worthless.

Re:Scientists call for ban on lethal, autonomous robots by noir_lord on Friday February 15, 2019 @10:32AM (#19171655)
One way the treaties help is they reduce R&D expenditure because their is no legal market for the products which slows the progression.

Not much point engineering something you can't sell.

It's not a perfect solution but its a positive outcome.

It also puts diplomatic and PR pressure on countries who use weapons generally prohibited which also is good.

The problem generally is that technology continues to improve and the cost of doing things continues to drop.

I've no idea what it would cost to build a cruise missile using off the shelf components and props instead of jets (and I'm not going to Google it) but on YouTube there are people operating remote control aircraft at long ranges with love video feedback, that's a payload away from a smart bomb already.

In reality targets are soft enough that you don't need to do those kinds of things to attack a civilian area but that doesn't mean they couldn't.

The recent drone at Gatwick shows the problems.

Re:Scientists call for ban on lethal, autonomous robots by dalbasal on Friday February 15, 2019 @10:36AM (#19171696)
That's a good point. Banning weapons lessens military industries ability to produce them. They tend to be made locally, within the militaries themselves and that often means less/worse... Eg Syria/Assad.
Re:Scientists call for ban on lethal, autonomous robots by dalbasal on Friday February 15, 2019 @08:30AM (#19170720)
This is a silly pedantic point...

I don't think Israel (or India, Pakistan & North Korea) broke the npt rules. The treaty doesn't regulate non signatories and allows countries to withdraw from the agreement. North Korea is the recent one. They gave their 3 month notice, withdrew and tested nukes without violating the treaty.

Ultimately, I don't really think the treaty was the biggest direct factor limiting proliferation.

When it was signed, peaceful nuclear tech was expected to be the most important technology of the century. The treaty was supposed to exclude non-members from accessing peaceful nuclear technology. It did that quite effectively (Israel never had nuclear power for this reason).

But unexpectedly, it's 2019 and nuclear energy isn't that important.

The npt did help forming a consensus though, and policing that consensus outside of the treaty. Helping anyone nuclearize is taboo. Five more countries (possibly six) did develop nuclear weapons after the npt, but the barriers were pretty huge, diplomatically and technically... because they got very little help.

Re:Scientists call for ban on lethal, autonomous robots by dsfyu404ed on Friday February 15, 2019 @10:08AM (#19171452)
>Helping anyone nuclearize is taboo

Only because most of the nations that haven't got them but are seeking them are poor nations that don't have a lot of close friends among the nuclear nations. It's kind of a "got mine, screw you" deal. Iran and the like have just as much right to develop and hold nuclear weapons as everyone else.

The thought of "regional troublemaker" having nuclear weapons countries bothers nations like the US, Russia, France, (etc) for the same reason some people at the top of the social hierarchy doesn't want poor people to have easy access to firearms. Those already at the top generally don't like seeing the playing field leveled and it's true all the way from the individual level to the national level.

In a democratic society if the party you want to push around is well enough armed to hurt you back that limits your ability to push them around to cases where you are actually consider to be "in the right" by the court of public opinion otherwise the people will promptly decide that it's not worth it.

Re:Scientists call for ban on lethal, autonomous robots by dalbasal on Friday February 15, 2019 @10:33AM (#19171669)
It's not about rich or poor. It's about whether or not you had them at the time the treaty was written.

China, UK & France are in. Japan & Germany are out, because they were occupied and demilitarised at the time. Both large, rich countries. China was large, but poor at that time.

Re:Scientists call for ban on lethal, autonomous robots by dsfyu404ed on Friday February 15, 2019 @12:04PM (#19172546)
I agree that rich and poor is probably too broad of a brush but there's definitely an in group and out group with which rich/poor generally, but not perfectly aligns. I'm talking more about the current political landscape anyway.

Everyone turns a blind eye to Israel (they're in the in group) but if any middle eastern, African or South American nation were to seriously pursue nuclear weapons the hand wringing would be immense (and is, in the case of Iran).

Re:Scientists call for ban on lethal, autonomous robots by rhizome31 on Friday February 15, 2019 @07:22AM (#19170254)
IANAL but does it matter whether it can be enforced or not? There are plenty of types of crimes that cannot be easily detected or prevented and are indeed committed at high rates. But they are still forbidden and should remain so.
Re:Scientists call for ban on lethal, autonomous robots by Nasrudith on Friday February 15, 2019 @08:29AM (#19170713)
There is an older theory of law that only things which are enforcable (which detectability is a requirement for) should be illegal otherwise it only breeds contempt for the law. This was way back when the concerns were more "could a king enforce it" than any notion of natrual rights. Personally I think that philosophy is not wrong at very least even if other valid frameworks could exist.
Re:Scientists call for ban on lethal, autonomous robots by johnisgood on Friday February 15, 2019 @07:52AM (#19170450)
So what exactly is the point?
Re:Scientists call for ban on lethal, autonomous robots by atoav on Friday February 15, 2019 @08:17AM (#19170626)
The point is that we were able to mostly get rid of chemical weapons and landmines, which is also not easy to enforce.

The effectiveness of enforcement is no argument.

Re:Scientists call for ban on lethal, autonomous robots by Just_Smith on Friday February 15, 2019 @08:29AM (#19170717)
It is indeed an argument, and the idea that the laws around landmines and chemical weapons are what caused them to occur less is very selective reasoning. Those two cases are weapons that have a blowback towards those who wield them (Korea, Vietnam, and Afghanistan are still cleaning up landmines), and it's just as likely that their diminishing was due to there being less costly ways to kill people.

Inability to enforce is exactly why prohibition has been a colossal failure, so how is the ability to enforce irrelevant to a law's success?

Re:Scientists call for ban on lethal, autonomous robots by atoav on Friday February 15, 2019 @10:01AM (#19171397)
Things like these are hard to judge, but a ban is a sign of intent and not a perfect solution to prevent a certain situation.

We collectively agree to ban certain things (e.g. murder), because there are multiple reasons to do so. Some of these reasons are humanitarian, some rational, some economic etc. Yet we see proof each day that neither laws nor punishment will stop murder from happening.

The idea of a ban is not to stop things — but to increase the (social, economical, ...) cost of certain behaviour.

Any actor who fears that cost will abstain from chemical weapons for example. But just like with murder you will always have actors that either decide it is a prize worth taking, or they never ever thought about it at all.

Hard to say how effective those bans were, but they certainly helped to nudge some actors into adopting higher standards.

And once there is a standard the majority agrees on it is hard to go back to a lower standard..

Re:Scientists call for ban on lethal, autonomous robots by hutzlibu on Friday February 15, 2019 @10:10AM (#19171469)
"and it's just as likely that their diminishing was due to there being less costly ways to kill people."

Politicaly costly, as more and more people pressured for more human ways of war. Because mines are a very effective and cheap military strategy. (where mines are you don't need so much troops). I say it was the boulevard pictures of children without legs, that did it. And maybe will so again after the first killbots gone rouge..

Because I doubt any big military would miss out the opportunity to at least be able to flip the switch to let them operate and shoot autonom, when you have more cheap massproduced robots than operators and need them and or the enemy is jamming you and the situation is critical.

Re:Scientists call for ban on lethal, autonomous robots by learc83 on Friday February 15, 2019 @12:55PM (#19173049)
>and it's just as likely that their diminishing was due to there being less costly ways to kill people

Land mines are by far the cheapest modern method for area denial unless we're considering dirty bombs.

Re:Scientists call for ban on lethal, autonomous robots by sergioj97 on Friday February 15, 2019 @09:22AM (#19171095)
I don't think he has said it was irrelevant. He said it was no argument for not banning them.
Re:Scientists call for ban on lethal, autonomous robots by delinka on Friday February 15, 2019 @07:58AM (#19170500)
Consequences. You risk suffering the consequences if you commit a crime. Society deems something as Bad (calling it crime), punishes those who commit crime.

We’re hoping society agrees that making autonomous lethal robots should be Bad and deserve punitive consequences. And hopefully, those who commit this crime will be caught and suffer the consequences.

Re:Scientists call for ban on lethal, autonomous robots by ptero on Friday February 15, 2019 @08:10AM (#19170575)
IMO having any law that is rarely enforced is a bad idea. That gives authorities the choice of whom to pursue and whom to let go, which is often used to hound parties (people, groups or countries) for arbitrary reasons citing the law in question as a reason for persecution.

Laws should be clear and non-burdensome for the majority. And violations caught at the high rate. My 2c.

Re:Scientists call for ban on lethal, autonomous robots by rhizome31 on Friday February 15, 2019 @08:15AM (#19170613)
A typical example of a crime that is very rarely punished is rape. I hope you'll agree that it should nevertheless remain banned.
Re:Scientists call for ban on lethal, autonomous robots by Nasrudith on Friday February 15, 2019 @08:42AM (#19170817)
There is a difference between rarely enforced and rarely punished. In antiquity before forensics if someone murdered someone on a country road and cleaned their clothes and cleaned or disposed of their weapon nobody would ever know who did it without a confession. However if they saw someone murdering a man in the street they would mob the assailant and capture or kill him.

The first case they may bury bodies and set an armed patrol of some sort for roving bandits but the murderer would never be punished per say.

However if nearly everyone drinks and alcohol is illegal but bars operate openly yeah that law is bad it is only being used as a pretext.

Re:Scientists call for ban on lethal, autonomous robots by dsfyu404ed on Friday February 15, 2019 @08:43AM (#19170819)
It's rarely punished because it's hard to prosecute. When an actionable case is dropped in a prosecutor's lap they're happy to take it to court.
Re:Scientists call for ban on lethal, autonomous robots by teawrecks on Friday February 15, 2019 @08:25AM (#19170689)
No one said don't enforce it, they said it's difficult to enforce. Those are very different.
Re:Scientists call for ban on lethal, autonomous robots by dwighttk on Friday February 15, 2019 @08:51AM (#19170882)
eh... I'm glad there is a speed limit on the road in front of my house even though a lot of people drive 10 mph faster.
Re:Scientists call for ban on lethal, autonomous robots by ptero on Friday February 15, 2019 @11:10AM (#19172006)
OK, but in a similar situation (speed limit that most people exceed by 5-10 mph), I would prefer that the speed limit was raised by 5 mph, and then enforced all time time (e.g., via a well-calibrated speed camera), not randomly when the town needs extra cash and places a traffic cop nearby to extract a tax.
Re:Scientists call for ban on lethal, autonomous robots by Mirioron on Friday February 15, 2019 @09:38AM (#19171216)
Society only punishes you if society knows about it and has enough power to do something about it. If the US signs a treaty to ban killer robots but builds them anyway then nobody can force them to stop.
Re:Scientists call for ban on lethal, autonomous robots by atoav on Friday February 15, 2019 @10:19AM (#19171541)
This is to binary IMO. I think imany ban is about increasing the cost of a certain behaviour and by these means decreasing the likelyhood of an actor to adopt it.

No human agreement will ever be able to stop a 100% of anything. But that doesn’t imply it isn’t worth increasing the cost (financial, social and otherwise) to certain types of behaviour.

People seem to agree quite uniformly with banning and punishing murder for example, although these laws and punishments don’t seem to stop murder as has been proven over centuries. Few would murder their neighbour over a small dispute, because the cost for doing so is extremely high. Much more people would e.g. kill the rapist of their child, because the notion of cost might be irrelevant under such circumstances and it is much more socially acceptable to do so.

Of course there is more than just cost. It can also be a matter of culture. If you live in a culture were getting shot for miniscule reasons is not something that happens, you are also far less likely to see shooting at somebody for miniscule reasons as an option

Re:Scientists call for ban on lethal, autonomous robots by reitanqild on Friday February 15, 2019 @10:01AM (#19171396)
But then the rest of the world can agree it was evil.

Just like the world can mostly agree it was evil to arrange a civil war in Eastern Ukraine or invade Iraq etc etc:

There will always be people who more or less genuinely argue that the last invasion of Iraq was necessary or that a certain superpower next to Ukraine has nothing to do with the well supplied rebels in their back yard.

For the rest of us we can all agree to despise both of these.

Re:Scientists call for ban on lethal, autonomous robots by ApolloFortyNine on Friday February 15, 2019 @10:15AM (#19171515)
I don't think the World agrees that it was evil to invade Iraq. A lot of the World participated in that invasion actually... At the end of the day Saddam was not exactly a peaceful dictator.

I think hacker news should be above inflammatory posts like these.

Re:Scientists call for ban on lethal, autonomous robots by reitanqild on Friday February 15, 2019 @03:18PM (#19174332)
Have my upvote. I did not intend it to be inflammatory, in fact I rewrote it once before posting to make sure it wasn't.

I posted something I was sure most HN-ers could agree on, - but as someone who frequently disagrees with many of you I probably should have known better.

Re:Scientists call for ban on lethal, autonomous robots by mc32 on Friday February 15, 2019 @08:16AM (#19170625)
In principle yes, but what happens when a pariah state like Venezuela or Iran decide to do this, no amount of international ostracizing and sanctions will deter them. What leverage are you going to use to enforce this?
Re:Scientists call for ban on lethal, autonomous robots by rhizome31 on Friday February 15, 2019 @08:04AM (#19170535)
The point is that when people get caught they can be sent to court and sentenced.

Some people are scared of that and don't do the forbidden thing.

Take the act of stealing for example. It is ridiculously easy to do and indeed it is committed a lot. Yet most societies prefer to ban it, hoping that fear of sentence will prevent some people to do it.

Re:Scientists call for ban on lethal, autonomous robots by Symmetry on Friday February 15, 2019 @08:03AM (#19170530)
>Hobbyists have already mounted guns on quadcopters.

ISIS has actually already used (remote controlled) quadcopters to conduct grenade strikes.

https://www.c4isrnet.com/unmanned/uas/2018/01/05/how-650-dro...

You can make a distinction between human-in-the-loop weapons versus human-on-the-loop supervision versus robots killing with no supervision. But of course landmines have been completely autonomous weapons since the US civil war. It's a place where it's really hard to make bright line distinctions.

Re:Scientists call for ban on lethal, autonomous robots by SmellyGeekBoy on Friday February 15, 2019 @08:04AM (#19170537)
> But of course landmines have been completely autonomous weapons since the US civil war.

Excellent point.

Re:Scientists call for ban on lethal, autonomous robots by phkahler on Friday February 15, 2019 @08:10AM (#19170573)
I was going to bring up landmines but I googled it first:

https://en.wikipedia.org/wiki/International_Campaign_to_Ban_...

It is not a bad comparison. I can even imagine a robot/drone sent it with orders to kill everyone in a certain area. It gets lost or whatever and runs out of power. Years later some kid finds it, charges it up and turns it on...

Re:Scientists call for ban on lethal, autonomous robots by robotresearcher on Friday February 15, 2019 @11:27AM (#19172148)
Spiked pits, poisoned wells, bear traps and caltrops have been around a whole lot longer than landmines and have most of the properties in question. This is not a new issue.
Re:Scientists call for ban on lethal, autonomous robots by detaro on Friday February 15, 2019 @07:31AM (#19170307)
Landmines are easy to make too, still it's worthwhile to ban their use.
Re:Scientists call for ban on lethal, autonomous robots by scotty79 on Friday February 15, 2019 @07:51AM (#19170439)
Are they banned? Does the ban do anything?

I think USA has huge pile of banned weapons like bio and chemical weapons.

Re:Scientists call for ban on lethal, autonomous robots by Symmetry on Friday February 15, 2019 @08:09AM (#19170568)
The US has long since destroyed its biological weapons and mostly its chemical ones too. As Nixon said "If someone uses germs on us, we'll nuke 'em."

The USSR put anthrax warheads on a lot of their ICBMs, mostly because it was cheaper and they weren't as enamored with the idea that it might be possible to win a nuclear war by destroying one's opponent's weapons in a first strike, something bio weapons are useless for.

Re:Scientists call for ban on lethal, autonomous robots by warmwaffles on Friday February 15, 2019 @07:59AM (#19170510)
> I think USA has huge pile of banned weapons like bio and chemical weapons.

This is not necessarily true. We are disposing of them and last time I checked there are only two sites now that have weapons and their numbers are decreasing daily.

Sites that have since disposed of all weapons that I know about.

1. Johnston Island 2. Umatilla, Oregon 3. Little Rock, Arkansas

source: my father has been doing this for 29 years

Re:Scientists call for ban on lethal, autonomous robots by officemonkey on Friday February 15, 2019 @08:22AM (#19170666)
The US had been destroying chemical weapons for decades, due to treaty obligations. Thinking is not knowing.
Re:Scientists call for ban on lethal, autonomous robots by warmwaffles on Monday February 18, 2019 @08:18AM (#19190407)
yes and we've been consulting with many other nations on destroying them. Ukraine, russia, etc...
Re:Scientists call for ban on lethal, autonomous robots by cmurf on Friday February 15, 2019 @03:56PM (#19174635)
U.S. landmine policy is mostly aligned with the Ottawa Convention, with an exception for the Korean peninsula https://www.state.gov/t/pm/wra/c11735.htm
Re:Scientists call for ban on lethal, autonomous robots by kkarakk on Friday February 15, 2019 @07:56AM (#19170479)
ban is on use and not on stockpiling. it's all legal distinctions to avoid incurring penalties in the global economy. wars aren't even fought in the open anymore,you fight them via proxy "liberations" in failed nation states. for eg russia vs europe/usa vs iran vs saudi arabia in syria or china vs india via pakistan
Re:Scientists call for ban on lethal, autonomous robots by Nasrudith on Friday February 15, 2019 @09:12AM (#19171020)
Also annoyingly biological weaponry requires specimens to create countermeasures like vaccines and antibodies. Even smallpox we have kept on ice and are debating if it should be incinerated to reduce the relatively minuscule escape chance or kept on ice in case we need to make more vaccines.

Hypothetically being able to digitize and compile it would allow incineration of every bioweapon but it comes with its own dilemma. The one advantage is that if it comes out of bits and into pathogens it was definitely deliberate. The disadvantage of course is that it can be printed with the right equipment.

Re:Scientists call for ban on lethal, autonomous robots by harrumph on Friday February 15, 2019 @07:33AM (#19170318)
>Lethal robots are not a technology that can really be regulated by ban.

Bans aren't merely about regulating technology, they're about regulating human behavior by introducing consequences. They're about a society making a choice to introduce legal sanctions against persons who do something unambiguously reckless and destructive, such as handing an autonomous device the power to kill.

Responses that boil down to a shrug of the shoulders underscore an important observation: enthusiasts for technology are precisely the wrong people to ask about the importance of recklessness and risk. It's on par with asking someone in software sales for a warts-and-all perspective on their product.

Re:Scientists call for ban on lethal, autonomous robots by dTal on Friday February 15, 2019 @09:23AM (#19171100)
One thing I've noticed is that the type of hacker-person one often finds on HN - the kind of person who looks at the world in terms of what is technically possible - has a gaping blind spot when it comes to the distinction between "anyone could do this" and "everyone can do this". The infamous Dropbox announcement thread is instructive - your average hacker type poo poos it because it's trivial, but its existence still changes the world in meaningful ways.

There is a huge qualitative difference between "anyone could put a gun on a quadcopter" and "everyone can buy a quadcopter with a gun on it".

Re:Scientists call for ban on lethal, autonomous robots by harrumph on Friday February 15, 2019 @01:46PM (#19173552)
>gaping blind spot when it comes to the distinction between "anyone could do this" and "everyone can do this"

Agree. These are exactly the enormously important subtleties that are lost when education omits training in the humanities.

Re:Scientists call for ban on lethal, autonomous robots by ForHackernews on Friday February 15, 2019 @07:22AM (#19170261)
There's a big difference between a jerry-rigged bomb strapped to a quadcopter and a purpose-built killbot produced by a nation state. Strong international sanctions against warbots are a good idea, even if it won't prevent every terrorist from making their own low-rent version.
Re:Scientists call for ban on lethal, autonomous robots by Recurecur on Friday February 15, 2019 @07:32AM (#19170314)
"There's a big difference between a jerry-rigged bomb strapped to a quadcopter and a purpose-built killbot produced by a nation state. Strong international sanctions against warbots are a good idea, even if it won't prevent every terrorist from making their own low-rent version."

Killbots built by nation-states (essentially) are already available for purchase. How does an autonomous helicopter drone armed with an AK-47 sound? ;-)

>The Blowfish A2 “autonomously performs complex combat missions, including fixed-point timing detection and fixed-range reconnaissance, and targeted precision strikes.”

>Depending on customer preferences, Chinese military drone manufacturer Ziyan offers to equip Blowfish A2 with either missiles or machine guns.

>Mr Allen wrote: “Though many current generation drones are primarily remotely operated, Chinese officials generally expect drones and military robotics to feature ever more extensive AI and autonomous capabilities in the future.

>“Chinese weapons manufacturers already are selling armed drones with significant amounts of combat autonomy.”

>China is also interested in using AI for military command decision-making.

https://www.technocracy.news/china-releases-fully-autonomous...

China and Russia will ignore any treaties on this, just as Russia has already ignored many including the INF Treaty. As in many other cases, the West will essentially tie its own hands while allowing others to literally get away with murder.

Re:Scientists call for ban on lethal, autonomous robots by Recurecur on Friday February 15, 2019 @08:07AM (#19170556)
So I see this was downvoted without any effort to rebut the story...

Anyone care to explain?

It should also be mentioned that the drone I linked to above was being shown at an arms show, and is essentially being offered for sale to all comers. I'm sure there'll be healthy sales to some of the more autocratic/aggressive nations out there...

Re:Scientists call for ban on lethal, autonomous robots by iliketosleep on Friday February 15, 2019 @09:09AM (#19170996)
I totally agree with your point and have raised this issue before (but not here). Most people prefer to bury their heads in the sand rather than confront these uncomfortable and complicated dilemmas.

I believe the scientists in question would not be calling for this kind of ban if their sons and daughters were sent into battle against nations equipped with such weapons - in fact, they would be cooperating to develop this very technology if it meant protecting their loved ones.

It's easy to be an idealist, until you've truly got something to lose. I think a lot of people need to be reminded of this.

Re:Scientists call for ban on lethal, autonomous robots by pbhjpbhj on Friday February 15, 2019 @09:14AM (#19171033)
So, I had to reread your middle para because I honestly thought you were heading an entirely different direction.

Do you think it should be legal for citizens to carry RPGs, machine guns, grenades, ..., so they never have to go in to a room in which someone else might have more firepower?

Re:Scientists call for ban on lethal, autonomous robots by michaelt on Friday February 15, 2019 @10:28AM (#19171624)
Pretty sure iliketosleep means "if their sons and daughters were in the military during a war, and were sent into battle" - after all, it'd be unusual to be sent into battle in any other circumstances.

And yes, I think most people agree it should be legal for soldiers to carry machine guns and grenades when in warzones during wars.

Re:Scientists call for ban on lethal, autonomous robots by pbhjpbhj on Friday February 15, 2019 @10:54AM (#19171864)
You misunderstood me. I was asking the question I wished the parent to answer.

The point the GP made was seemingly that we shouldn't let potential enemies have better weapons (autonomous drones), denying them for ourselves.

Yes, I assumed they were considering the context of state sanctioned aggression.

I wondered if they only found that reasoning appropriate for states, or in general.

One could ask "should we always seek for the most terrible weapons to be legal in any context in order to ensure no enemy can outmatch us due to restraints of law?".

Re:Scientists call for ban on lethal, autonomous robots by iliketosleep on Friday February 15, 2019 @06:32PM (#19175778)
To address the point that I think you're getting at, the difference between a military and civilian context is that is that the former is a potentially "no rules, everything at stake" situation. There is no international enforcement agency that can force all nations to abide by an agreed set of rules in any meaningful way. Thus, in a practical sense, there's no restriction on the type of weapons the enemy may develop and a nation must be on the cutting edge of military tech at all times "just in case".

In the civilian context, enforcement agencies in most first-world countries are able to restrict weapons and violence reasonably well - most people won't see the need to arm themselves and will prefer to be law abiding. But in countries rife with violence where law enforcement is weak or corrupt, I imagine people would try to arm themselves with what they can regardless legal constraints.

Re:Scientists call for ban on lethal, autonomous robots by Konnstann on Friday February 15, 2019 @12:28PM (#19172802)
I think that reasoning is valid for state-sanctioned aggression, or war to be precise. Personally I think that as long as collateral damage is minimal, we should strive to develop the most deadly, most efficient weapons we can, specifically for the purposes of deterring unchecked aggression.

I don't think GP was making an argument that I should carry an AK-47 on me so that any muggers i come across are less likely to out-arm me.

Re:Scientists call for ban on lethal, autonomous robots by pbhjpbhj on Friday February 15, 2019 @01:29PM (#19173403)
Thanks. Per your 2nd para, why not, what's different in you legally allowing the availability of the most deadly means in the two contexts?
Re:Scientists call for ban on lethal, autonomous robots by Konnstann on Friday February 15, 2019 @04:09PM (#19174740)
Nation-states cannot, in my mind, be compared to individuals when it comes to propensity for aggression. The vast majority of individuals, in, say the U.S. are not armed, whereas the majority of nation-states have a military. Furthermore, the countries that are in proximity to "aggressive" states either have a strong military e.g. Israel, or have military presence from other countries with strong militaries e.g. South Korea.

Also, the distances between different countries vs the spread of information is also vastly different. It is harder to commit an international act of violence with no witnesses than it is an interpersonal one, and the threat of retaliation keeps violence at bay, for the most part at least.

Re:Scientists call for ban on lethal, autonomous robots by chrisseaton on Friday February 15, 2019 @07:52AM (#19170443)
> produced by a nation state

Why do people always say ‘nation state’ in these situations? It’s not a fancy word for ‘major country’ - it means something specific. For example the UK is definitely not a nation state. The US is arguably not a nation state either, due to its cultural and lingual heterogeneity and tribal sovereignty.

Re:Scientists call for ban on lethal, autonomous robots by ForHackernews on Friday February 15, 2019 @08:43AM (#19170822)
Fine, substitute "state actor" or whatever pedantic term you prefer.

Jargon nitpicking is my second-least-favourite kind of HN nitpicking, coming in close ahead of "Boy there was an advert on that article!/Why U no adblock?" nitpicking.

Re:Scientists call for ban on lethal, autonomous robots by United857 on Friday February 15, 2019 @08:18AM (#19170632)
Especially in American English, the term nation state is often used to disambugiate from a 'state' at the sub national level -- eg one of the 50 US ones.
Re:Scientists call for ban on lethal, autonomous robots by SCHiM on Friday February 15, 2019 @08:20AM (#19170651)
The uk and us are definitely referred to as nation states in cyber Warfare lingo. I think the meaning is close to: group with lots of resources and strategic goal directed in that context.
Re:Scientists call for ban on lethal, autonomous robots by chrisseaton on Friday February 15, 2019 @08:24AM (#19170683)
That's the same mistaken meaning that the original commenter is using.

A nation state is a nation that is also a state. The UK clearly is a union of four nations into one kingdom. I mean - the clue's in the name.

Re:Scientists call for ban on lethal, autonomous robots by az123zaz on Friday February 15, 2019 @09:14AM (#19171029)
As many have noted in American English this distinguishes from a state (as in the United States).

Additionally "nation" can refer to the collective people rather than a centralized government in action.

Re:Scientists call for ban on lethal, autonomous robots by pbhjpbhj on Friday February 15, 2019 @08:34AM (#19170754)
It's 3 kingdoms, they are "united".
Re:Scientists call for ban on lethal, autonomous robots by chrisseaton on Friday February 15, 2019 @08:37AM (#19170783)
They're nations. Why do you think Wales has a 'national' assembly if it isn't a nation? Why do you think they have their own 'national' bodies for things such as sports? Why do you think they compete separately in competitions like the 'six nations'?
Re:Scientists call for ban on lethal, autonomous robots by pbhjpbhj on Friday February 15, 2019 @10:19AM (#19171545)
Wales is a curious one, I've tried to establish when it became a "nation" best I can do is some time in the last 100 years or so.

Unless you're going to separate out historic county kingdoms (Wessex, Sussex, Kent, Gwent, etc.) then England annexed the counties that compromise the region we now call Wales as lands of the English Crown.

The UK was initially formed by the Union of two kingdoms, England and Scotland at which time all the parts of Great Britain were under the same Monarch.

Your contention doesn't necessarily disagree with this historical fact.

Re:Scientists call for ban on lethal, autonomous robots by jstanley on Friday February 15, 2019 @09:18AM (#19171051)
It is 1 kingdom, which is united.

It's "the United Kingdom of Great Britain and Northern Ireland", not the "United Kingdoms of Great Britain, Northern Ireland, and whatever 3rd one you have in mind"

Re:Scientists call for ban on lethal, autonomous robots by pbhjpbhj on Friday February 15, 2019 @11:01AM (#19171931)
Two then Great Britain and Ulster. Though Lord Steel appeared to imply it should be 3 on calling her Queen of Scots when the Scottish Parliament opened.

I was under the seemingly false impression that the Queen was separately Queen of England and Scotland still/again. But it does appear she is Queen "of Great Britain, Ireland and the British Dominions beyond the Seas" making her Queen of 2 kingdoms (Great Britain, Ulster) within the UK?

Re:Scientists call for ban on lethal, autonomous robots by kkarakk on Friday February 15, 2019 @07:59AM (#19170506)
"nation state"

Dictionary result for nation state noun a sovereign state of which most of the citizens or subjects are united also by factors which define a nation, such as language or common descent.

so you can call anything a nation state as long as that thing issues a passport i guess?

Re:Scientists call for ban on lethal, autonomous robots by chrisseaton on Friday February 15, 2019 @08:06AM (#19170548)
> so you can call anything a nation state as long as that thing issues a passport i guess?

What? No - you just gave the argument against that!

> are united also by factors which define a nation, such as language or common descent

This means the UK isn't a nation state - we have four nations in the UK, with different cultures, descents, and in some areas even languages.

It also means that the US is not a nation state - the people there have very distinct descents. Today Americans literally still say they're 'Italian' rather than 'American'. Many Americans don't speak English. The US literally describes tribal lands as 'dependent nations', so it isn't one nation even by their own federal definition.

Examples of nation states are places like Iceland and Portugal. These are the major military players that the original comment was trying to refer to.

Re:Scientists call for ban on lethal, autonomous robots by dannypgh on Friday February 15, 2019 @08:17AM (#19170630)
It's possible for a person to be a member of multiple nations. In the eyes of many Americans (USian), American most certainly is a nation.

MAGA-style nationalism is quite popular and powerful at the moment...

Re:Scientists call for ban on lethal, autonomous robots by chrisseaton on Friday February 15, 2019 @08:23AM (#19170674)
Yes establishing your own nation as a state is a goal for many nationalists. And you can see some nationalists pointing at Japan (a nation-state) and saying that they'd prefer their state to be more homogenous like Japan.
Re:Scientists call for ban on lethal, autonomous robots by Symmetry on Friday February 15, 2019 @08:11AM (#19170586)
Korea is one nation divided into two different states. And the Soviet Union was one state comprised of several nations which later split apart.
Re:Scientists call for ban on lethal, autonomous robots by ljcn on Friday February 15, 2019 @07:58AM (#19170498)
It sounds fancier than "state"? Which is what was meant I think.
Re:Scientists call for ban on lethal, autonomous robots by swarnie_ on Friday February 15, 2019 @07:27AM (#19170287)
> There's a big difference between a jerry-rigged bomb strapped to a quadcopter and a purpose-built killbot produced by a nation state

Aren't we already there thought? Don't the US already have semi-autonomous flying kill-driods? The ones that occasional crash Pakistani weddings unannounced.

Re:Scientists call for ban on lethal, autonomous robots by epochwolf on Friday February 15, 2019 @07:35AM (#19170333)
If you count ICBMs, we’ve had them at least since the 1960s.

For more targeted strikes with conventional explosives, we started using Tomahawk Cruise Missiles in 1991 during the Gulf War.

Re:Scientists call for ban on lethal, autonomous robots by Recurecur on Friday February 15, 2019 @07:59AM (#19170511)
Those aren't autonomous weapons in the sense meant here.

Both of what you mention attack a predetermined target - a target selected by humans.

This technology is about "smart weapons" going out and searching for targets. For instance, the Chinese helicopter drone I mentioned in another post could easily be fitted with an IR sensor, and could probably hit targets out to ~200 meters with the AK.

One challenge is IFF (Identification Friend or Foe), but if you just want the drone(s) to kill all "enemies" within a certain boundary that'd be easy. AK ammo is even cheap, unlike the $500K missiles we often use to blow up individual jihadis...

And of course, at any time a human could potentially take control or at least monitor activity.

Re:Scientists call for ban on lethal, autonomous robots by adrianN on Friday February 15, 2019 @07:48AM (#19170422)
Those are lethal but non-autonomous weapons afaik. A human pulls the trigger.
Re:Scientists call for ban on lethal, autonomous robots by dvfjsdhgfv on Friday February 15, 2019 @07:32AM (#19170311)
> Strong international sanctions against warbots are a good idea, even if it won't prevent every terrorist from making their own low-rent version.

Assuming that all nations follow. Otherwise one rogue player can have a huge advantage, and that's the general problem with trying to ban military technologies.

Re:Scientists call for ban on lethal, autonomous robots by adrianN on Friday February 15, 2019 @07:49AM (#19170428)
The same is true for chemical or biological weapons. Banning them has worked reasonably well during WW2.
Re:Scientists call for ban on lethal, autonomous robots by scotty79 on Friday February 15, 2019 @07:55AM (#19170474)
However scary they are they are not particularly effective agains enemy combatants. That's the main reason the ban sort of works.
Re:Scientists call for ban on lethal, autonomous robots by tomatotomato37 on Friday February 15, 2019 @09:50AM (#19171305)
That's mostly because nukes are a better value once their manufacturing infrastructure is up. They're essentially a bioweapon with a really big boom included (purchase now and get an EMP pulse for free!)
Re:Scientists call for ban on lethal, autonomous robots by Mirioron on Friday February 15, 2019 @09:47AM (#19171292)
>Strong international sanctions against warbots are a good idea, even if it won't prevent every terrorist from making their own low-rent version.

Why? I read the article, but I'm not buying the "would increase conflict" angle. Some countries are in constant conflict anyway. It's not like the reason they're not fighting more is because they have a lack of men. A lack of equipment is much more likely to be the limiting factor.

Re:Scientists call for ban on lethal, autonomous robots by codyb on Friday February 15, 2019 @08:37AM (#19170775)
Certainly, but when it's ten or twenty jerry rigged drone bombs I'm not so sure it make a ton of difference.

Swarm warfare is going to be cheap and interesting.

That's why the US can spend a quarter million on IUD proof humvees, and the insurgence can just put pointed caps on them to pierce the armor.

It's a lot cheaper to fuck shit up than it is to defend against it.

Re:Scientists call for ban on lethal, autonomous robots by scotty79 on Friday February 15, 2019 @07:52AM (#19170449)
I think blinding lasers are even easier to make and they are still banned.
Re:Scientists call for ban on lethal, autonomous robots by taneq on Friday February 15, 2019 @07:57AM (#19170495)
> Tesla and Waymo

Tesla and Uber, you mean. Unless there's been an incident with Waymo that I'm not aware of?

Re:Scientists call for ban on lethal, autonomous robots by hannasanarion on Friday February 15, 2019 @10:18AM (#19171540)
You're right, I was thinking of the Phoenix accident, I'd forgot that was Uber, not waymo
Re:Scientists call for ban on lethal, autonomous robots by realcr on Friday February 15, 2019 @07:58AM (#19170499)
> Even the rulebreakers, like Israel, couldn't hide the fact that they were doing it and had to rely on America's UNSC veto to save them from the consequences.

A bit unrelated, but I couldn't ignore it. Could you expand on this one? In what sense is Israel a rulebreaker? What are the consequences?

I don't read the news very often, but I do remember there are some actors that are seemingly working towards obtaining nuclear weapons, and their leaders publicly claim they want to harm other countries. To be sure I'm not totally detached from reality I googled a bit:

http://www.timesofisrael.com/iran-supreme-leader-touts-9-poi...

https://www.telegraph.co.uk/news/2018/04/22/iran-pledges-des...

Re:Scientists call for ban on lethal, autonomous robots by knightofmars on Friday February 15, 2019 @08:05AM (#19170541)
"The tale serves as a historical counterpoint to today's drawn-out struggle over Iran's nuclear ambitions. The parallels are not exact – Israel, unlike Iran, never signed up to the 1968 NPT so could not violate it. But it almost certainly broke a treaty banning nuclear tests, as well as countless national and international laws restricting the traffic in nuclear materials and technology."

https://www.theguardian.com/world/2014/jan/15/truth-israels-...

Re:Scientists call for ban on lethal, autonomous robots by maeln on Friday February 15, 2019 @08:08AM (#19170560)
I supposed he is talking about the Treaty on the Non-Proliferation of Nuclear Weapons [0]. Israel never signed it though (Iran did), so you cannot really called them "rule breaker" (they didn't sign the "rule"). Although, I think that not signing the treaty doesn't protect you from having sanction from the U.N. But U.S veto did protect them I guess.

[0] https://en.wikipedia.org/wiki/Treaty_on_the_Non-Proliferatio...

Re:Scientists call for ban on lethal, autonomous robots by codyb on Friday February 15, 2019 @08:27AM (#19170700)
I believe GP is talking about Israel's oft denied nuclear missles program which everyone knows they have but they refuse to confirm.

They're probably breaking some nuclear non proliferation treaty put into place by a bunch of nuclear powers. (Whether there's anything wrong with the people with sticks saying no sticks is a different matter).

Israel definitely has nukes already, they're not working towards it.

Re:Scientists call for ban on lethal, autonomous robots by WhompingWindows on Friday February 15, 2019 @09:23AM (#19171101)
Waymo has not killed anyone, you're thinking of Uber. Waymo has a MUCH safer/better product than Uber or these other SDC startups. Arguably Tesla's AP has only killed one of the many of thousands of drivers who use Autopilot - one of their two deaths was a guy watching Harry Potter on his laptop and not watching the road.
Re:Scientists call for ban on lethal, autonomous robots by grawprog on Friday February 15, 2019 @01:15PM (#19173246)
Kalashnikov has already created autonomous death robots.

https://newatlas.com/kalashnikov-ai-weapon-terminator-conund...

Re:Scientists call for ban on lethal, autonomous robots by Zigurd on Friday February 15, 2019 @10:44AM (#19171776)
There are many examples of lo tech weapons that have been effectively banned. By effectively I mean they're not used by regular militaries.
Re:Scientists call for ban on lethal, autonomous robots by cmurf on Friday February 15, 2019 @02:39PM (#19174025)
Israel is not and hasn't ever been a NPT signatory so they're not breaking the rules by having a nuclear weapons program.
Re:Scientists call for ban on lethal, autonomous robots by empath75 on Friday February 15, 2019 @07:26AM (#19170280)
You don’t even need to make a change to hardware. Fly a big enough drone into a building and it’s lethal.
Re:Scientists call for ban on lethal, autonomous robots by giancarlostoro on Friday February 15, 2019 @07:28AM (#19170297)
You could do that with a regular privately owned airplane too, and arguably more damage.
Re:Scientists call for ban on lethal, autonomous robots by hannasanarion on Friday February 15, 2019 @07:33AM (#19170323)
but without sacrificing any of your people, or even needing people to be involved. If US drones were autonomous, then somebody could press the "destroy islamabad" button and they'd all take off, fire all their missiles, and crash into buildings on their own, with no humans involved. That's the kind of capability we want to avoid. Robots are cheap, people are not.
Re:Scientists call for ban on lethal, autonomous robots by isostatic on Friday February 15, 2019 @07:37AM (#19170355)
> Robots are cheap, people are not.

Depends on the country

Re:Scientists call for ban on lethal, autonomous robots by zaarn on Friday February 15, 2019 @07:33AM (#19170316)
Yes but you can build or buy drones in much larger quantities for cheap. With enough planning you could target weakpoints in the structure and bring down a large building more reliably than with an airplane and with less loss of life (on your side).