News for hackers. Stuff that matters.
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by hackuser on Thursday August 25, 2016 @02:43PM (#12361374)
Should exploits like this be treated as munitions, with sale to foreign governments restricted? Or any sale at all restricted? Some thoughts:

* The only uses for the exploits are either illegal or by government security organizations

* I don't think you can just make an explosive and sell it to a foreign government; I think there are strict export controls (though I know very few details, I only read about companies applying, getting approval, etc.).

* In the 1990s, strong encryption was called a 'munition' and export was restricted. That turned out to be impractical (it was available in many countries and the Internet has no borders), morally questionable (restricting private citizen's privacy), and it fell apart.

While I believe in liberty and freedom-to-tinker, as I said, this stuff has no legitimate use.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by tptacek on Thursday August 25, 2016 @02:57PM (#12361491)
No, exploits are more widely used in industry (for testing and red-teaming) than they are by governments, simply because there are more red teams than there are government-sponsored intelligence and police agencies.

It's hard to imagine a scheme under which exploits could be regulated in the US that wouldn't set precedents for whether code was protected speech. I think very few people on HN would be comfortable with those precedents.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by hackuser on Thursday August 25, 2016 @04:40PM (#12362314)
EDIT: As kbenson points out below, it's not just red teams but people wanting to tinker with their own equipment: Get data out of a proprietary app, install a 3rd party OS, unlock their phone, etc. That seems like a very difficult problem.

> It's hard to imagine a scheme under which exploits could be regulated in the US that wouldn't set precedents for whether code was protected speech

Yeah, I was thinking about that too ... and fully support freedom-to-tinker, etc. ...

First, no right is absolute. We can't slander people despite free speech rights, or commit human sacrifice despite freedom of religion, or own a fully automatic machine gun despite a right to bear arms (in the U.S.).

We'd want to create exceptions for research, etc (see below) but I don't think the line is prohibitively hard to draw. The big problem I see is open source security bug reporting: There should be a way to openly notify the vendor and public without releasing the exploit into the wild, but it is a little tricky.

> exploits are more widely used in industry (for testing and red-teaming) than they are by governments

Good point, but I don't think that's a big challenge. Exceptions could be made as they are for other 'munitions' and other illegal products (e.g., drugs used for research).

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by tptacek on Thursday August 25, 2016 @04:50PM (#12362393)
I'm not saying it's impossible to generate an intellectually coherent set of regulations for exploits, just that the process of doing so is going to damage the 1A protections of a lot of other things over the long run.

Is it worth it? I don't think so. Unless you also regulate research, which is a non-starter, you're just driving exploit development out of the US. Substantial amounts of exploit dev are already done by foreign nationals. If virtually all of it leaves the country, what public policy problem have you solved?

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by hackuser on Thursday August 25, 2016 @05:13PM (#12362559)
> If virtually all of it leaves the country, what public policy problem have you solved?

A good point. A couple ideas, though neither is sufficient:

* International agreements control distribution of other dangerous goods; that's doable. However, look at how well that works with drugs, and even nukes get around.

* At least stop sophisticated organizations (defense contractors, SV firms, etc.) from making them for foreign governments. Their skills are harder, though not impossible, to replace. Perhaps ban the sale of exploits - taking away the profit motive - but permit distribution for personal, research, etc. purposes.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by tptacek on Thursday August 25, 2016 @05:51PM (#12362782)
I don't think you fully follow. The skills can't be regulated: they're pure research. The US research community will continuing doing the fundamental enabling work relied on by exploit developers; it's just the people who do the testing and integration work who'll have to have their paychecks sent to Southeast Asia.

It's a very difficult problem.

There's also some bigtime cognitive availability bias happening here. We read lurid stories centering on "zero-day exploits" and say "something must be done". But no matter what these articles say, it seems cosmically unlikely that an exploit dealer is worth a billion dollars; the entire exploit trade is a rounding error compared to the switching and filtering equipment companies knowingly sell China and Iran for use in putting dissidents to death.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by briandear on Thursday August 25, 2016 @06:03PM (#12362848)
Under that logic tape recorders should be regulated because they could be sold to people who would record your conversations illegally, then used to create a fake conversation using your own words in order to achieve some illegal end. Treating spyware as a munition is a dangerously slippery slope.

And slander is not a criminal offense but a civil one -- one has to prove actual damages to win a slander suit (at least in the US.) So spyware could fall under the slander concept where the victims could sure based on actual damages incurred.

So one would need to prove that a piece of spyware caused them actual damages. Then you get into some other interesting unintended consequences: could a browser extension or even a cookie be construed as being spyware? They kind of are -- except (generally) you consent to those things. However were would the line be drawn? Could a company like Mixpanel find themselves inadvertently having their product being considered a munition?

I take to to a slightly absurd extreme to illustrate how good intentions can have ridiculous consequences. Governments don't have the best track record when it comes to anticipating unintended consequences.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by smokeyj on Thursday August 25, 2016 @03:46PM (#12361910)
Isn't cryptography a controlled export?
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by rdtsc on Thursday August 25, 2016 @04:03PM (#12362035)
Yes in some contexts.

Most people don't know about it though. I think everyone thinks we won that "war" completely. Even talking to someone like Phil Zimmermann, he was wasn't aware about it.

Granted it is more about exporting to "rogue states" and more of a registration requirement. But it is something, companies (especially startups) probably forget to do. And I don't know of anyone personally who got in trouble over it.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by AgalmicVentures on Thursday August 25, 2016 @02:45PM (#12361386)
And to extend your thought further, should US based VC's be backing this? NSO is backed by San Fransisco based Fransisco Partners [1].

[1] http://www.reuters.com/article/us-nsogroup-m-a-idUSKCN0SR2JF...

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by digi_owl on Thursday August 25, 2016 @03:04PM (#12361552)
> * In the 1990s, strong encryption was called a 'munition' and export was restricted. That turned out to be impractical (it was available in many countries and the Internet has no borders), morally questionable (restricting private citizen's privacy), and it fell apart.

IIRC, thats still on the books. Its just one of those sleeping paragraphs since the PGP release.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by avian on Thursday August 25, 2016 @03:17PM (#12361659)
Debian documents mention that "BXA revised the provisions of the EAR governing cryptographic software" in October 2000. Debian no longer has separate non-us repositories for crypto because of that.

https://www.debian.org/legal/cryptoinmain

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by makomk on Thursday August 25, 2016 @04:31PM (#12362242)
Open source software is now basically exempt from the crypto export restrictions, which is why Debian doesn't need separate non-US repositories for it anymore. As far as I know closed-source software is still restricted.
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by jeff_marshall on Thursday August 25, 2016 @08:02PM (#12363412)
Only "Military or intelligence cryptographic (including key management) systems" are included in the current US munitions list [1]. Everything else is handled by the Department of Commerce as part of the export administration regulations (EAR) [2].

[1]https://www.pmddtc.state.gov/regulations_laws/documents/offi...

[2] https://www.bis.doc.gov/index.php/policy-guidance/encryption

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by tedunangst on Thursday August 25, 2016 @03:12PM (#12361625)
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by chetanahuja on Thursday August 25, 2016 @09:57PM (#12363855)
"it was available in many countries and the Internet has no borders"

Ummm... tell that to the Chinese or anyone, anywhere in the world trying to watch the complete international Netflix catalog. And as for VPNs, they're like the tunnels under the actual physical borders which are also not impenetrable.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by jacquesm on Thursday August 25, 2016 @02:48PM (#12361409)
Which foreign governments though? Not all security researchers are from your country (whichever one that may be).
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by kbenson on Thursday August 25, 2016 @03:02PM (#12361531)
I had the same thought as hackuser when reading the article, and then it was quickly followed by your point. I think an important first step would be to get certain things classified as arms. Once that's done, normal options may be able to handle them appropriately, such as not allowing the purchase or sale of certain types of arms within or over borders, etc.

This would of course open up a whole new can of worms in the US, as we are constitutionally guaranteed the right to bear arms, but that's just makes it hard, not impossible (and could possibly even serve to provide some much needed nuance to that discussion in the US).

That said, I haven't put a lot of thought into this, so a well reasoned criticism could completely change my stance.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by tedunangst on Thursday August 25, 2016 @03:11PM (#12361614)
Would it then be illegal for Google Project Zero to publish a blog post about a vulnerability that a vendor refuses to fix?
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by kbenson on Thursday August 25, 2016 @03:33PM (#12361801)
I was thinking less of the knowledge being considered an armament, and more that an actual program that takes advantage of it being one. I don't consider the the scientific knowledge required to create a gun as an armament, nor even specific schematics, but governments may view it differently (indeed, they weren't happy about the 3D printable gun).

Also, I don't think this concept is limited specifically to exploiting bugs. I think a program that was meant to access and catalog social media accounts for a person while hiding it's accesses as much as possible, but run from a third party's location, might be considered an armament. Same with something designed to DoS a service.If the purpose is to cause harm, it might be an armament. I am aware there's probably a fine line here, and one that would inevitably be abused. I'm not sure how to deal with that, and whether the negatives there outweigh the possible positives overall.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by tedunangst on Thursday August 25, 2016 @05:41PM (#12362724)
Separating code from knowledge was part of the fun of the decss debacle. "That's not a haiku; that's an illegal perl script!"
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by AnthonyMouse on Thursday August 25, 2016 @06:51PM (#12363101)
And fundamentally it's the knowledge that matters. Programmers are "expensive" but not that expensive. Give any decent off-the-shelf code monkey the specifics of a vulnerability and he can give you exploit code.

Which means restricting the exploit code is quite useless. But restricting the knowledge itself doesn't work because the same knowledge is necessary to mitigate the vulnerability and to test that the mitigation is effective.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by makomk on Thursday August 25, 2016 @10:44PM (#12363982)
These days, exploiting vulnerabilities in most interesting code actually seems to be quite fiddly thanks to all the mitigation techniques and requires a bunch of specialist knowledge and tools that isn't exactly trivial to come by. The knowledge is already restricted, just for commercial rather than legal reasons.
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by AnthonyMouse on Thursday August 25, 2016 @11:41PM (#12364116)
Which is still knowledge. If you have the information you can make the tools.

I mean obviously in reality the line between "information" and "software" is non-existent because software is just a type of information, but if you insist on trying to draw a line anyway then it still fails because it's still possible to convey everything of significance using natural language, and the skillset required to convert plain language instructions into software is not rare enough to be prohibitive.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by pixl97 on Friday August 26, 2016 @09:07AM (#12365904)
>thanks to all the mitigation techniques and requires a bunch of specialist knowledge and tools that isn't exactly trivial to come by

Eh, specialist knowledge yes. Restricted, no. Getting documents on how chips and software has always been somewhat restricted, just be a linux person and try to get documentation from Broadcom on how their wifi/lan chips work, for example.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by hackuser on Thursday August 25, 2016 @09:23PM (#12363741)
I don't recall seeing that spirit and creativity in a long time. Or am I just getting old and cranky?

The battle for end-user control seems surrendered, at least by all but a few.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by hackuser on Thursday August 25, 2016 @04:31PM (#12362233)
> we are constitutionally guaranteed the right to bear arms

It doesn't extend to all arms; e.g., you don't have a right to own anti-aircraft guns, weaponized anthrax, or even fully automatic rifles. What side of the line the exploits fall on is of course a question, but if I'm right that their only civilian use is illegal harm to others (e.g., you don't use them to protect your home or hunt deer) then it's simpler.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by kbenson on Thursday August 25, 2016 @04:39PM (#12362308)
Yes, and that's what I meant about making it hard, not impossible. That said, there are uses of exploits which can be said are for the purpose of protecting property. I might conceivably want to use an Android or iOS exploit to liberate some of my data from my phone if some apps are less forthcoming with that data than I would like.
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by hackuser on Thursday August 25, 2016 @04:44PM (#12362339)
> I might conceivably want to use an Android or iOS exploit to liberate some of my data from my phone if some apps are less forthcoming with that data than I would like.

A great point that I should have thought of. I wish I could edit my original post and add that consideration.

I can draw a conceptual line: Ban using exploits on other people's equipment. But practically, I don't see how to stop that without criminalizing distribution, in which case I can't get my data from my phone (or install a 3rd party OS) without the vendor's permission.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by AnthonyMouse on Thursday August 25, 2016 @07:07PM (#12363179)
> I can draw a conceptual line: Ban using exploits on other people's equipment. But practically, I don't see how to stop that without criminalizing distribution, in which case I can't get my data from my phone (or install a 3rd party OS) without the vendor's permission.

I don't understand what the problem is supposed to be. You don't need laws against knives because there are already laws against assault and murder and there is no harm in having a knife you use to cut carrots. Then you prosecute people for the bad things they actually do.

The justifiable laws against specific weapons are for the exceedingly dangerous ones like plutonium and smallpox. That isn't this.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by hackuser on Thursday August 25, 2016 @09:17PM (#12363706)
> You don't need laws against knives because there are already laws against assault and murder

A good point. In this case it's so hard to catch perpetrators that to stop the crimes, it could be necessary to ban the weapons or their distribution (if that even is a practical option).

Are the other similar situations, where perpetrators are so hard to catch and you have to ban the means? Counterfeiting is all I can think of, and they don't ban color printers they just put tracking tech in them. Also, color printers are dual-use: They have many legitimate uses, exploits have very few.

> The justifiable laws against specific weapons are for the exceedingly dangerous ones like plutonium and smallpox. That isn't this.

Weapons that help foreign governments oppress large parts of their population might qualify, though clearly not all exploits fit that description.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by AnthonyMouse on Friday August 26, 2016 @12:35AM (#12364255)
> Are the other similar situations, where perpetrators are so hard to catch and you have to ban the means?

The nearest thing is clearly DMCA 1201. The problem of course being that DMCA 1201 is an epic failure. DRM circumvention tools are widely available to pirates, meanwhile it regularly subjects honest people to a choice between breaking the law and having it interfere with their legitimate activities.

> Also, color printers are dual-use: They have many legitimate uses, exploits have very few.

Exploits seem to have more legitimate uses than illegitimate ones. The only illegitimate use that comes to mind is wrongfully breaking into systems, which is the mirror image of the legitimate use of rightfully breaking into systems, in case you somehow get locked out (or some malicious third party locks you out).

Then on top of that, sysadmins require exploits to verify that a patch actually prevents the exploit. And proof of concept exploits are sometimes the only way to convince a vendor to fix a vulnerability. And academics need to study the newest actual exploits in order to keep up with what currently exists in the wild.

> Weapons that help foreign governments oppress large parts of their population might qualify, though clearly not all exploits fit that description.

Smallpox is inherently dangerous. Some exploits could be specifically dangerous in the sense that some very sensitive systems could be vulnerable to them, but only in the same sense that a Fire Axe could be used to break down some doors leading to very sensitive areas. The problem then is not that the public has access to axes, it's that there aren't enough independent security layers protecting sensitive systems.

And you can't fix that problem by banning tools because a high value target with bad security will fall to a state-level attacker regardless. The only answer is to improve the security of sensitive targets.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by kbenson on Friday August 26, 2016 @01:37AM (#12364424)
> Smallpox is inherently dangerous.

I think the equivalent (or much worse, actually) for exploits is something that is self replicating and disruptive. For example, a bug in the BGP routing protocol (or a certain percentage of the common implementations) that propagates bogus routes and disrupts some or all traffic for affected systems and spreads. Something that disrupted a large enough chunk of global traffic would not only be horrendous in its own right, but would also make dissemination of any fix quite problematic.

Then again, I assume it's probably good practice to somewhat lock down how BGP functions in your routers (if that makes sense. I'm not that familiar with it), but a certain incident from last year[1] leads me to believe that's either not possible, hard to do, or people just don't do it.

1: http://www.bgpmon.net/massive-route-leak-cause-internet-slow...

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by pixl97 on Friday August 26, 2016 @09:16AM (#12365955)
The analogy still fails.

If you have the tooling to keep smallpox and not kill yourself you can also keep ebola around too, if you go to the effort to go find it. Really dangerous stuff and is going to be costly.

The problem here is I can make and keep 'digital smallpox' on my home PC, and for many pieces of equipment it is surprisingly easy to find exploits for them. Are you planning on watching every computer? Every person in the world?

Take a lesson from the failed war on drugs, where there is significant profit motivation people will do what is necessary to make massive amounts of money. There are massive amounts of money in blackhat work.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by AnthonyMouse on Friday August 26, 2016 @11:56AM (#12367090)
Which is exactly what I mean by "there aren't enough independent security layers protecting sensitive systems." We've known that BGP has terrible security for many years.

Fixing it is hard because it requires a lot of independent parties to agree on what to do and update their routers. In theory this is the sort of thing a government could help with by providing funding, to fund research into solutions and/or provide cash incentives to early adopters.

But the market also solves these things eventually, since successful attacks are bad for business. It just takes for the attacks to actually happen first in that case.

Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by jessaustin on Thursday August 25, 2016 @06:19PM (#12362941)
Haha that would be a well-protected home.
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by givinguflac on Thursday August 25, 2016 @03:07PM (#12361578)
The only legitimate use of this is a jailbreak tool. Obviously 'this' being the root exploit and not the malware/data capturing portion. I agree malware like that should be treated as munitions.
Re:NSO Group's iPhone Zero-Days used against a UAE Human Rig... by briandear on Thursday August 25, 2016 @06:13PM (#12362908)
Really then, a tape recorder should be considered a munition under that logic.

Malware shouldn't be considered a munition any more than encryption should have been.

Unless the malware actually makes your phone explode, then it's a stretch to call it a munition.

Do we really want governments getting into the code review business?