The ban isn't a flip-switch that says: "hey, no more of these", it's the start of a formal dialogue over our relationship to these new technologies and how we would like to see them used on a worldwide basis.
If a country were to opt to drop thousands of flying drones with guns onto a military base is that different than chemical weapons? a fuel air bomb? conventional explosives? sending special forces in?
Yeah, they're all different with different repercussions, long term impacts, potential civilian casualties, etc. etc.
I think we can pretty much count on every group with a gripe reaching for autonomous drone swarms first in the future.
They do run into the problem you described. Most militaries have them. Paramilitaries and sub-state forces (even criminals) have them. They sometimes get used, even by relatively law abiding forces.
Despite all that, those treaties do significantly impact their use in various ways. Diplomatic concerns do affect choices in conflict. These treaties put a diplomatic price on the use of certain weapons. They limit trade in these weapons.
Weapons treaties are not about perfectly police able, and internally consistent rules. No rules of war are. That doesn't mean they are entirely worthless.
Not much point engineering something you can't sell.
It's not a perfect solution but its a positive outcome.
It also puts diplomatic and PR pressure on countries who use weapons generally prohibited which also is good.
The problem generally is that technology continues to improve and the cost of doing things continues to drop.
I've no idea what it would cost to build a cruise missile using off the shelf components and props instead of jets (and I'm not going to Google it) but on YouTube there are people operating remote control aircraft at long ranges with love video feedback, that's a payload away from a smart bomb already.
In reality targets are soft enough that you don't need to do those kinds of things to attack a civilian area but that doesn't mean they couldn't.
The recent drone at Gatwick shows the problems.
I don't think Israel (or India, Pakistan & North Korea) broke the npt rules. The treaty doesn't regulate non signatories and allows countries to withdraw from the agreement. North Korea is the recent one. They gave their 3 month notice, withdrew and tested nukes without violating the treaty.
Ultimately, I don't really think the treaty was the biggest direct factor limiting proliferation.
When it was signed, peaceful nuclear tech was expected to be the most important technology of the century. The treaty was supposed to exclude non-members from accessing peaceful nuclear technology. It did that quite effectively (Israel never had nuclear power for this reason).
But unexpectedly, it's 2019 and nuclear energy isn't that important.
The npt did help forming a consensus though, and policing that consensus outside of the treaty. Helping anyone nuclearize is taboo. Five more countries (possibly six) did develop nuclear weapons after the npt, but the barriers were pretty huge, diplomatically and technically... because they got very little help.
Only because most of the nations that haven't got them but are seeking them are poor nations that don't have a lot of close friends among the nuclear nations. It's kind of a "got mine, screw you" deal. Iran and the like have just as much right to develop and hold nuclear weapons as everyone else.
The thought of "regional troublemaker" having nuclear weapons countries bothers nations like the US, Russia, France, (etc) for the same reason some people at the top of the social hierarchy doesn't want poor people to have easy access to firearms. Those already at the top generally don't like seeing the playing field leveled and it's true all the way from the individual level to the national level.
In a democratic society if the party you want to push around is well enough armed to hurt you back that limits your ability to push them around to cases where you are actually consider to be "in the right" by the court of public opinion otherwise the people will promptly decide that it's not worth it.
China, UK & France are in. Japan & Germany are out, because they were occupied and demilitarised at the time. Both large, rich countries. China was large, but poor at that time.
Everyone turns a blind eye to Israel (they're in the in group) but if any middle eastern, African or South American nation were to seriously pursue nuclear weapons the hand wringing would be immense (and is, in the case of Iran).
The effectiveness of enforcement is no argument.
Inability to enforce is exactly why prohibition has been a colossal failure, so how is the ability to enforce irrelevant to a law's success?
We collectively agree to ban certain things (e.g. murder), because there are multiple reasons to do so. Some of these reasons are humanitarian, some rational, some economic etc. Yet we see proof each day that neither laws nor punishment will stop murder from happening.
The idea of a ban is not to stop things — but to increase the (social, economical, ...) cost of certain behaviour.
Any actor who fears that cost will abstain from chemical weapons for example. But just like with murder you will always have actors that either decide it is a prize worth taking, or they never ever thought about it at all.
Hard to say how effective those bans were, but they certainly helped to nudge some actors into adopting higher standards.
And once there is a standard the majority agrees on it is hard to go back to a lower standard..
Politicaly costly, as more and more people pressured for more human ways of war. Because mines are a very effective and cheap military strategy. (where mines are you don't need so much troops). I say it was the boulevard pictures of children without legs, that did it. And maybe will so again after the first killbots gone rouge..
Because I doubt any big military would miss out the opportunity to at least be able to flip the switch to let them operate and shoot autonom, when you have more cheap massproduced robots than operators and need them and or the enemy is jamming you and the situation is critical.
Land mines are by far the cheapest modern method for area denial unless we're considering dirty bombs.
We’re hoping society agrees that making autonomous lethal robots should be Bad and deserve punitive consequences. And hopefully, those who commit this crime will be caught and suffer the consequences.
Laws should be clear and non-burdensome for the majority. And violations caught at the high rate. My 2c.
The first case they may bury bodies and set an armed patrol of some sort for roving bandits but the murderer would never be punished per say.
However if nearly everyone drinks and alcohol is illegal but bars operate openly yeah that law is bad it is only being used as a pretext.
No human agreement will ever be able to stop a 100% of anything. But that doesn’t imply it isn’t worth increasing the cost (financial, social and otherwise) to certain types of behaviour.
People seem to agree quite uniformly with banning and punishing murder for example, although these laws and punishments don’t seem to stop murder as has been proven over centuries. Few would murder their neighbour over a small dispute, because the cost for doing so is extremely high. Much more people would e.g. kill the rapist of their child, because the notion of cost might be irrelevant under such circumstances and it is much more socially acceptable to do so.
Of course there is more than just cost. It can also be a matter of culture. If you live in a culture were getting shot for miniscule reasons is not something that happens, you are also far less likely to see shooting at somebody for miniscule reasons as an option
Just like the world can mostly agree it was evil to arrange a civil war in Eastern Ukraine or invade Iraq etc etc:
There will always be people who more or less genuinely argue that the last invasion of Iraq was necessary or that a certain superpower next to Ukraine has nothing to do with the well supplied rebels in their back yard.
For the rest of us we can all agree to despise both of these.
I think hacker news should be above inflammatory posts like these.
I posted something I was sure most HN-ers could agree on, - but as someone who frequently disagrees with many of you I probably should have known better.
Some people are scared of that and don't do the forbidden thing.
Take the act of stealing for example. It is ridiculously easy to do and indeed it is committed a lot. Yet most societies prefer to ban it, hoping that fear of sentence will prevent some people to do it.
ISIS has actually already used (remote controlled) quadcopters to conduct grenade strikes.
https://www.c4isrnet.com/unmanned/uas/2018/01/05/how-650-dro...
You can make a distinction between human-in-the-loop weapons versus human-on-the-loop supervision versus robots killing with no supervision. But of course landmines have been completely autonomous weapons since the US civil war. It's a place where it's really hard to make bright line distinctions.
Excellent point.
https://en.wikipedia.org/wiki/International_Campaign_to_Ban_...
It is not a bad comparison. I can even imagine a robot/drone sent it with orders to kill everyone in a certain area. It gets lost or whatever and runs out of power. Years later some kid finds it, charges it up and turns it on...
I think USA has huge pile of banned weapons like bio and chemical weapons.
The USSR put anthrax warheads on a lot of their ICBMs, mostly because it was cheaper and they weren't as enamored with the idea that it might be possible to win a nuclear war by destroying one's opponent's weapons in a first strike, something bio weapons are useless for.
This is not necessarily true. We are disposing of them and last time I checked there are only two sites now that have weapons and their numbers are decreasing daily.
Sites that have since disposed of all weapons that I know about.
1. Johnston Island 2. Umatilla, Oregon 3. Little Rock, Arkansas
source: my father has been doing this for 29 years
Hypothetically being able to digitize and compile it would allow incineration of every bioweapon but it comes with its own dilemma. The one advantage is that if it comes out of bits and into pathogens it was definitely deliberate. The disadvantage of course is that it can be printed with the right equipment.
Bans aren't merely about regulating technology, they're about regulating human behavior by introducing consequences. They're about a society making a choice to introduce legal sanctions against persons who do something unambiguously reckless and destructive, such as handing an autonomous device the power to kill.
Responses that boil down to a shrug of the shoulders underscore an important observation: enthusiasts for technology are precisely the wrong people to ask about the importance of recklessness and risk. It's on par with asking someone in software sales for a warts-and-all perspective on their product.
There is a huge qualitative difference between "anyone could put a gun on a quadcopter" and "everyone can buy a quadcopter with a gun on it".
Agree. These are exactly the enormously important subtleties that are lost when education omits training in the humanities.
Killbots built by nation-states (essentially) are already available for purchase. How does an autonomous helicopter drone armed with an AK-47 sound? ;-)
>The Blowfish A2 “autonomously performs complex combat missions, including fixed-point timing detection and fixed-range reconnaissance, and targeted precision strikes.”
>Depending on customer preferences, Chinese military drone manufacturer Ziyan offers to equip Blowfish A2 with either missiles or machine guns.
>Mr Allen wrote: “Though many current generation drones are primarily remotely operated, Chinese officials generally expect drones and military robotics to feature ever more extensive AI and autonomous capabilities in the future.
>“Chinese weapons manufacturers already are selling armed drones with significant amounts of combat autonomy.”
>China is also interested in using AI for military command decision-making.
https://www.technocracy.news/china-releases-fully-autonomous...
China and Russia will ignore any treaties on this, just as Russia has already ignored many including the INF Treaty. As in many other cases, the West will essentially tie its own hands while allowing others to literally get away with murder.
Anyone care to explain?
It should also be mentioned that the drone I linked to above was being shown at an arms show, and is essentially being offered for sale to all comers. I'm sure there'll be healthy sales to some of the more autocratic/aggressive nations out there...
I believe the scientists in question would not be calling for this kind of ban if their sons and daughters were sent into battle against nations equipped with such weapons - in fact, they would be cooperating to develop this very technology if it meant protecting their loved ones.
It's easy to be an idealist, until you've truly got something to lose. I think a lot of people need to be reminded of this.
Do you think it should be legal for citizens to carry RPGs, machine guns, grenades, ..., so they never have to go in to a room in which someone else might have more firepower?
And yes, I think most people agree it should be legal for soldiers to carry machine guns and grenades when in warzones during wars.
The point the GP made was seemingly that we shouldn't let potential enemies have better weapons (autonomous drones), denying them for ourselves.
Yes, I assumed they were considering the context of state sanctioned aggression.
I wondered if they only found that reasoning appropriate for states, or in general.
One could ask "should we always seek for the most terrible weapons to be legal in any context in order to ensure no enemy can outmatch us due to restraints of law?".
In the civilian context, enforcement agencies in most first-world countries are able to restrict weapons and violence reasonably well - most people won't see the need to arm themselves and will prefer to be law abiding. But in countries rife with violence where law enforcement is weak or corrupt, I imagine people would try to arm themselves with what they can regardless legal constraints.
I don't think GP was making an argument that I should carry an AK-47 on me so that any muggers i come across are less likely to out-arm me.
Also, the distances between different countries vs the spread of information is also vastly different. It is harder to commit an international act of violence with no witnesses than it is an interpersonal one, and the threat of retaliation keeps violence at bay, for the most part at least.
Why do people always say ‘nation state’ in these situations? It’s not a fancy word for ‘major country’ - it means something specific. For example the UK is definitely not a nation state. The US is arguably not a nation state either, due to its cultural and lingual heterogeneity and tribal sovereignty.
Jargon nitpicking is my second-least-favourite kind of HN nitpicking, coming in close ahead of "Boy there was an advert on that article!/Why U no adblock?" nitpicking.
A nation state is a nation that is also a state. The UK clearly is a union of four nations into one kingdom. I mean - the clue's in the name.
Additionally "nation" can refer to the collective people rather than a centralized government in action.
Unless you're going to separate out historic county kingdoms (Wessex, Sussex, Kent, Gwent, etc.) then England annexed the counties that compromise the region we now call Wales as lands of the English Crown.
The UK was initially formed by the Union of two kingdoms, England and Scotland at which time all the parts of Great Britain were under the same Monarch.
Your contention doesn't necessarily disagree with this historical fact.
It's "the United Kingdom of Great Britain and Northern Ireland", not the "United Kingdoms of Great Britain, Northern Ireland, and whatever 3rd one you have in mind"
I was under the seemingly false impression that the Queen was separately Queen of England and Scotland still/again. But it does appear she is Queen "of Great Britain, Ireland and the British Dominions beyond the Seas" making her Queen of 2 kingdoms (Great Britain, Ulster) within the UK?
Dictionary result for nation state noun a sovereign state of which most of the citizens or subjects are united also by factors which define a nation, such as language or common descent.
so you can call anything a nation state as long as that thing issues a passport i guess?
What? No - you just gave the argument against that!
> are united also by factors which define a nation, such as language or common descent
This means the UK isn't a nation state - we have four nations in the UK, with different cultures, descents, and in some areas even languages.
It also means that the US is not a nation state - the people there have very distinct descents. Today Americans literally still say they're 'Italian' rather than 'American'. Many Americans don't speak English. The US literally describes tribal lands as 'dependent nations', so it isn't one nation even by their own federal definition.
Examples of nation states are places like Iceland and Portugal. These are the major military players that the original comment was trying to refer to.
MAGA-style nationalism is quite popular and powerful at the moment...
Aren't we already there thought? Don't the US already have semi-autonomous flying kill-driods? The ones that occasional crash Pakistani weddings unannounced.
For more targeted strikes with conventional explosives, we started using Tomahawk Cruise Missiles in 1991 during the Gulf War.
Both of what you mention attack a predetermined target - a target selected by humans.
This technology is about "smart weapons" going out and searching for targets. For instance, the Chinese helicopter drone I mentioned in another post could easily be fitted with an IR sensor, and could probably hit targets out to ~200 meters with the AK.
One challenge is IFF (Identification Friend or Foe), but if you just want the drone(s) to kill all "enemies" within a certain boundary that'd be easy. AK ammo is even cheap, unlike the $500K missiles we often use to blow up individual jihadis...
And of course, at any time a human could potentially take control or at least monitor activity.
Assuming that all nations follow. Otherwise one rogue player can have a huge advantage, and that's the general problem with trying to ban military technologies.
Why? I read the article, but I'm not buying the "would increase conflict" angle. Some countries are in constant conflict anyway. It's not like the reason they're not fighting more is because they have a lack of men. A lack of equipment is much more likely to be the limiting factor.
Swarm warfare is going to be cheap and interesting.
That's why the US can spend a quarter million on IUD proof humvees, and the insurgence can just put pointed caps on them to pierce the armor.
It's a lot cheaper to fuck shit up than it is to defend against it.
Tesla and Uber, you mean. Unless there's been an incident with Waymo that I'm not aware of?
A bit unrelated, but I couldn't ignore it. Could you expand on this one? In what sense is Israel a rulebreaker? What are the consequences?
I don't read the news very often, but I do remember there are some actors that are seemingly working towards obtaining nuclear weapons, and their leaders publicly claim they want to harm other countries. To be sure I'm not totally detached from reality I googled a bit:
http://www.timesofisrael.com/iran-supreme-leader-touts-9-poi...
https://www.telegraph.co.uk/news/2018/04/22/iran-pledges-des...
https://www.theguardian.com/world/2014/jan/15/truth-israels-...
[0] https://en.wikipedia.org/wiki/Treaty_on_the_Non-Proliferatio...
They're probably breaking some nuclear non proliferation treaty put into place by a bunch of nuclear powers. (Whether there's anything wrong with the people with sticks saying no sticks is a different matter).
Israel definitely has nukes already, they're not working towards it.
https://newatlas.com/kalashnikov-ai-weapon-terminator-conund...
Depends on the country
It's not like nuclear weapons, where you need a huge industrial operation with tens of thousands of high-tech centrifuges running for years before you have enough fissile material for a bomb. Even the rulebreakers, like Israel, couldn't hide the fact that they were doing it and had to rely on America's UNSC veto to save them from the consequences.
But lethal robots are a trivial step away from the current state of robotics. Hobbyists have already mounted guns on quadcopters. Tesla and Waymo have made robots that kill people accidentally. Any robot can be made a killer robot with minimal change to its software and hardware.