News for hackers. Stuff that matters.
Re:Don't expose the docker socket, even to a container by insaneirish on Wednesday September 23, 2015 @11:18PM (#10269642)
> They're not designed to allow running isolated arbitrary code in some sort of multi-tenancy setup

You mean Linux containers are not designed for this, nor are they designed to be secure. What a sad design failure.

Some [1] container technology was developed with security as a first principle.

[1]: http://us-east.manta.joyent.com/jmc/public/opensolaris/ARChi...

Re:Don't expose the docker socket, even to a container by kentonv on Thursday September 24, 2015 @12:18AM (#10269785)
Linux containers are certainly intended to be secure. The problem is that the Linux kernel API is huge and privilege escalation bugs are found all the time. In order to make a container secure, you need to disable 95% of this API, e.g. using seccomp, not mounting /proc or /sys, drastically limiting /dev, etc. Sandstorm.io hasn't seen a single working breakout since we started keeping track over a year ago, despite numerous Linux kernel exploits going by in that time, because all the bugs have been in features that we turned off.

https://docs.sandstorm.io/en/latest/developing/security-prac...

That said, there is a cost in compatibility. Most apps can be made to run just fine in this constrained environment, but it does sometimes require tweaks. Docker is more interested in compatibility than in security, so naturally they don't do this kind of attack surface reduction by default. (You can configure it manually, but realistically if it isn't mandatory then few people will bother.)

Re:Don't expose the docker socket, even to a container by benmmurphy on Thursday September 24, 2015 @05:39AM (#10270672)
It is also important to note that Microsoft is not offering shared kernel on Azure using their new container technology because they believe it is too insecure. Microsoft might be a special case because their kernel has an especially large surface area. But I think the current cloud providers that are providing shared kernels are walking a very fine line when it comes to security. Seccomp obviously mitigates this problem and probably puts you in a better position than using a hypervisor if you lock things down very aggressively.
Re:Don't expose the docker socket, even to a container by geofft on Wednesday September 23, 2015 @11:27PM (#10269667)
And you can run Docker containers on SmartOS, using "LX-branded zones", which do Linux syscall emulation:

https://www.joyent.com/blog/triton-docker-and-the-best-of-al...

I'd be curious if the Joyent folks believe Triton to have the security properties that everyone seems to want out of Docker. It doesn't involve the standard Docker daemon, so it might.

Re:Don't expose the docker socket, even to a container by lloydde on Thursday September 24, 2015 @12:13AM (#10269777)
@geofft that is a great link, our CTO Bryan Cantrill continued to beat the drum at the Docker SF meetup in May 6, 2015. Video and transcript at https://www.joyent.com/developers/videos/bryan-cantrill-virt... . My favorite line is, "And, so in terms of the security of containers, from our perspective they have to be secure because if you're able to break out of a container into the global zone of SmartOS, you could delete the company."

Yesterday at http://containersummit.io/, Bryan's talk "Going Container Native" (video coming soon) was in the same vein, SmartOS (illumos) directly benefits from its Solaris lineage -- Solaris Zones were engineered for security. We, Joyent, absolutely do believe Triton has the security properties that everyone seems to want out of Docker, because Joyent has been running OS containers in multi-tenant production since ~2006.

Open source SmartDataCenter [1], rebranded Triton, is the exact same code that is run in Joyent's Public Cloud. This truth in code, product and service contributed to me leaving an OpenStack company to join Joyent two years ago.

1. https://github.com/joyent/sdc

Re:Don't expose the docker socket, even to a container by lloydde on Friday September 25, 2015 @05:12PM (#10280720)
Bryan's talk "Going Container Native" from earlier this week is now online: http://containersummit.io/events/sf-2015/videos/going-contai...
Re:Don't expose the docker socket, even to a container by stephenr on Thursday September 24, 2015 @12:57AM (#10269900)
Isn't this specifically a Docker failing? My understanding (from reading rather than use) is that LXC (the original Linux container project) provides a lot more in the way of security than Docker does?
Re:Don't expose the docker socket, even to a container by JoshTriplett on Thursday September 24, 2015 @12:00AM (#10269753)
As far as I can tell, Solaris Zones are no more secure than Linux containers; both use kernel-level isolation mechanisms, while sharing the same kernel between zones/containers. And thus they both have the same security property: secure as long as you can't successfully exploit a syscall, but if you can, you get kernel-level access.
Re:Don't expose the docker socket, even to a container by _delirium on Thursday September 24, 2015 @12:14AM (#10269779)
The security property of "secure unless there's an exploit" applies to basically everything (maybe excluding formally verified software), including Xen and KVM, so I don't see how that's a specific knock against Zones. Yes, if there's an exploit that lets you do something you shouldn't be able to do, you can break out of the container/VM. But, like Xen and KVM, Zones are so far fairly successfully used as an isolation mechanism for the public cloud, for some years now. And all three make the claim that you ought to be able to rely on their isolation mechanisms, and any hole in them will be considered a serious bug. Whereas the way Docker is using Linux containers doesn't seem secure enough to make that claim or be used for that purpose, at least not yet.
Re:Don't expose the docker socket, even to a container by JoshTriplett on Thursday September 24, 2015 @10:19AM (#10271728)
> The security property of "secure unless there's an exploit" applies to basically everything (maybe excluding formally verified software), including Xen and KVM, so I don't see how that's a specific knock against Zones.

Defense in depth. With KVM, you'd have to exploit the guest kernel, then exploit KVM's hardware emulation to get to host userspace, then escalate to host root/kernel. (And KVM can use seccomp to limit itself, making that last step harder.) With Linux containers or Solaris Zones, you run directly on top of the host kernel, so you just need a single kernel exploit.

In any case, Zones and containers have the same security properties (running directly on top of the kernel), so the original comment about Zones being more secure than containers makes no sense.

Re:Don't expose the docker socket, even to a container by skarap on Thursday September 24, 2015 @02:35AM (#10270181)
> Whereas the way Docker is using Linux containers doesn't seem secure enough...

Which is totally expected, because docker tries to be useful to the largest user-base possible. It would be quite harder to use if didn't support directory mounting (via -v). And it would be a total nightmare for almost every user if you had to specify a list of allowed syscalls for every container.

This reminds me the situation with SELinux a lot. It has improved a lot but I still see "disable SELinux" almost in every tutorial I read on CentOS, Fedora or RHEL.

Re:Don't expose the docker socket, even to a container by pjmlp on Thursday September 24, 2015 @04:15AM (#10270445)
> This reminds me the situation with SELinux a lot. It has improved a lot but I still see "disable SELinux" almost in every tutorial I read on CentOS, Fedora or RHEL.

Because security is hard.

Just look at the Mac OS X users running as root and disabling Gatekeeper.

Or the developers that stay away from the sandbox model.

One of the nice things of mobile OSes is that there isn't a way around the container model. Although the history with permissions kind of messes it.

Re:Don't expose the docker socket, even to a container by feld on Thursday September 24, 2015 @11:14AM (#10272058)
I know of only one Solaris Zone escape CVE in its entire existence.

http://www.cvedetails.com/cve/CVE-2008-5689/

I also know of only one FreeBSD Jail escape CVE in its entire existence.

https://www.freebsd.org/security/advisories/FreeBSD-SA-04:03...

These were years ago. Jails and zones are everywhere. You're kidding yourself if you think people haven't tried to attack them.

Re:Don't expose the docker socket, even to a container by JoshTriplett on Thursday September 24, 2015 @11:59AM (#10272347)
Oracle doesn't tend to disclose security vulnerabilities; they just silently fix them; the absence of CVEs is not the absence of vulnerabilities. On top of that, a vulnerability wouldn't need to be Zones-specific; almost any kernel exploit would work, unless it uses a syscall that only works in the "global" zone.
Re:Don't expose the docker socket, even to a container by feld on Thursday September 24, 2015 @03:11PM (#10273884)
You forget that Sun was in charge of Solaris for many years and was pretty open about such things.
Re:Don't expose the docker socket, even to a container by benmmurphy on Thursday September 24, 2015 @12:01PM (#10272370)
Any exploit against the kernel gaining code execution is a Solaris Zone escape or Freebsd jail escape.

Solaris got hit by the one in 2012 which is the non-canonical RIP which hit a bunch of operating systems.

FreeBSD has had numerous kernel exploits which could be used for zone escapes.

Re:Don't expose the docker socket, even to a container by feld on Thursday September 24, 2015 @03:13PM (#10273903)
Really? Which ones? I'm pretty sure local privilege exploits that give you root don't magically jump you into JID 0 (prison0), escaping the jail. You'd just have "root" in the jail.

edit: well i guess if your attacker knows you're on FreeBSD they could override to prison0 in the exploit. But it's a good thing we dont have a ton of local priv exploits, eh?

edit2: and that was a pretty ignorant statement of mine about root exploits anyway :)

Re:Don't expose the docker socket, even to a container by acconsta on Thursday September 24, 2015 @12:56AM (#10269899)
Are linux containers really not securable? That's how Google runs all their stuff in production.

http://research.google.com/pubs/pub43438.html

Re:Don't expose the docker socket, even to a container by geofft on Thursday September 24, 2015 @01:15AM (#10269960)
Google generally doesn't have to worry about mutually-untrusted containers.

The meaning of "Linux containers are not secure" is that untrusted code should not be given root privileges within a container. Google is generally not doing that. They have e.g. trusted Gmail code running on the same machine as trusted YouTube code, handling untrusted emails and untrusted videos. But the Gmail team is not worried about the YouTube team hacking them, or vice versa. The security mechanisms just need to keep honest people honest.

And when they do have untrusted, third-party code to run, for Google Cloud Platform, they use VMs or actual sandboxes: see section 6.1 of the paper you linked.

Re:Don't expose the docker socket, even to a container by acconsta on Thursday September 24, 2015 @01:35AM (#10270010)
No, but the Gmail team might be worried about some Russian guy finding a buffer overflow in YouTube's application. Then what? They can escalate privileges and read your email?
Re:Don't expose the docker socket, even to a container by KirinDave on Thursday September 24, 2015 @02:32AM (#10270170)
Google's deployment of Docker is less susceptible to this. They do additional partitioning of applications.
Re:Don't expose the docker socket, even to a container by acconsta on Thursday September 24, 2015 @03:11AM (#10270295)
Yeah... so it seems like Linux containers can be sufficiently hardened?
Re:Don't expose the docker socket, even to a container by the_mitsuhiko on Thursday September 24, 2015 @06:40AM (#10270863)
Not really. You physically seperate gmail and youtube.
Re:Don't expose the docker socket, even to a container by acconsta on Thursday September 24, 2015 @01:36PM (#10273129)
Source? How do you get 80% CPU utilization if you have to physically separate all your job types?

http://csl.stanford.edu/~christos/publications/2015.heracles...

Re:Don't expose the docker socket, even to a container by geofft on Thursday September 24, 2015 @06:10PM (#10275104)
Google has way more applications than just Gmail and YouTube.

Basically, if someone breaks into Gmail, you're already in deep trouble. You're not significantly better off because they didn't break into Hangouts. Same in the other direction. So you can run those on the same hardware.

If you think YouTube is less sensitive than Gmail (I don't know if Google actually does), you can separate those, sure. But there are enough applications that are no worse to break into than YouTube, like Photos. You can run those on the same hardware.

At Google's scale it's not too hard to say, this is the stuff we're ridiculously paranoid about and this is everything else, and get 80% CPU utilization on both infrastructures.

Re:Don't expose the docker socket, even to a container by KirinDave on Sunday October 04, 2015 @12:56PM (#10328030)
Google can afford to keep separate server flights for each app. They have a lot of money and a lot of dedicated computer power for actual revenue generators.
Re:Don't expose the docker socket, even to a container by notjack on Wednesday September 23, 2015 @11:20PM (#10269647)
I should clarify I mean Docker containers specifically, good point.
Re:Don't expose the docker socket, even to a container by pjmlp on Thursday September 24, 2015 @04:08AM (#10270422)
Specially since HP-UX and Tru64 were doing it already in the late 90's.