News for hackers. Stuff that matters.
Re:Docker Is Raising Funding at $1.3B Valuation by z3t4 on Friday August 18, 2017 @02:22PM (#15048529)
I dont understand containers. First you go to through great pain sharing and reusing libraries. Then you make a copy of all the libraries and the rest of the system for each program !?
Re:Docker Is Raising Funding at $1.3B Valuation by eatmyshorts on Friday August 18, 2017 @03:33PM (#15049081)
Others have discussed how docker uses a layered approach, and how two containers that share a base system will share most of the filesystem and memory.

The real power of containers comes with container orchestration (i.e. Kubernetes, Mesosphere, and OpenShift). By leveraging containers, container orchestration systems can provide high availability, scalability, and zero-downtime rollouts and rollbacks, among many other things. These things were hard before containers & container orchestration. By allowing containers to be moved between nodes in a cluster, one generally achieve higher hardware utilization than with VMs alone (which is in itself a big improvement upon software on bare-metal hardware). All of this also leads to easier/better continuous deployment, as well. This, in turn, leads to easier testing, and greatly simplifies provisioning of hardware for new projects.

So, the benefits are:

  - Cheaper than VMs (through better hardware utilization)
  - More reliable, through HA load balancers
  - More scalable, through scalability load balancers
  - Better testing, through CI/CD enabled by containers
  - Faster application delivery by simplifying provisioning
Re:Docker Is Raising Funding at $1.3B Valuation by peterwwillis on Friday August 18, 2017 @03:51PM (#15049209)
Except:

  - Nobody ever used VMs the way containers are
  - A HA load balancer is not a container-specific concept
  - There is no such thing as a 'scalability load balancer'
  - You don't need a container to do CI/CD
  - It's not faster, it's slower, and it's not simpler, it's more complex
Re:Docker Is Raising Funding at $1.3B Valuation by eatmyshorts on Friday August 18, 2017 @04:12PM (#15049360)
- Nobody ever used VMs the way containers are? Many people are using VMs to get better utilization of hardware by running multiple distinct apps on the same hardware. Containers do this, too. Container orchestration makes it really easy, allowing for even better hardware utilization than with VMs. You say that "nobody ever used VMs the way container are", yet I've got multiple clients that deployed to Kubernetes in large part because of this very point.

- I never said an HA load balancer is a container-specific concept. I said that "these things were hard before containers". I stand by that statement. Containers and container orchestration make HA proxies really, really simple.

- A scalability load balancer is a load balancer in front of a service that monitors load and scales up, or down, the number of instances behind that load balancer. Again, container orchestration makes this really easy.

- No you don't need a container to do CI/CD. But containers make it much, much easier.

- It is faster. I can provision an entire cluster of machines in about 5 minutes on AWS or GKE. If I have an existing cluster to publish to, it's even easier--it's one line in my continuous integration config file. Container orchestration has a learning curve (I'm assuming this is why you say "it's more complex"?), but it is tremendously easier and faster to provision hardware for a project with containers and container orchestration when compared to provision actual hardware, or even provisioning VMs.

Re:Docker Is Raising Funding at $1.3B Valuation by hueving on Saturday August 19, 2017 @01:47AM (#15051893)
Sounds like a lot of this is confusing containers with an API to control instances in general. Most of this is already achievable with the APIs offered by EC2, azure, VMware, openstack, etc.
Re:Docker Is Raising Funding at $1.3B Valuation by _seemethere on Friday August 18, 2017 @04:07PM (#15049328)
How is it slower to use containers than traditional machines? Provisioning for a container is basically just downloading an image and running it.

Sounds like you haven't really used containers at all.

Re:Docker Is Raising Funding at $1.3B Valuation by geggam on Friday August 18, 2017 @04:31PM (#15049491)
This and the fact docker in AWS creates several layers of NAT
Re:Docker Is Raising Funding at $1.3B Valuation by peterwwillis on Friday August 18, 2017 @03:08PM (#15048917)
It's basically leaning on shitty software engineering to produce increased reliability in release engineering/operations.

The old model was a system would be running, and a lot of software components within that system would depend on each other, creating a web of dependencies. If one of the dependencies had a problem, it could bring down the whole system [in theory].

The new model is "simpler" in that every software component has its own independent operating environment, with [supposedly] no dependency on the others. In this way, if one dependency fails, it can do so independent of the system at large - the failed piece is simply replaced by a different, identical piece. In addition, the component environments don't store state or anything else that would be necessary in order to replace it.

We basically bloat up our RAM and waste CPU and disk space in order to be able to understand and support the system in a more abstract way, in the service of better availability, and also, better scalability.

How is this different from simply running a bunch of chroot'ed services on a system without containers? It really isn't. But you get more control over the software by adding things like namespaces and control groups, and by everyone using the same containers, more uniformity. By dealing with the annoyance of abstractions and bloat, we get more human-friendly interoperability.

Re:Docker Is Raising Funding at $1.3B Valuation by femto113 on Friday August 18, 2017 @02:42PM (#15048692)
What you're missing is that if two containers have the same base they will share all of those resources (both on disk and in RAM). Thus while each container is a complete system you can still fit many more containers on a given host than you could VMs (which don't share anything with each other).
Re:Docker Is Raising Funding at $1.3B Valuation by rwmj on Friday August 18, 2017 @02:59PM (#15048847)
Hmm, well sometimes that is true. Because containers don't encourage stable APIs, another scenario is that each container has slightly differing versions of each library because of unnecessary API changes (or in the positive case, because they extensively test the program with a particular library version).
Re:Docker Is Raising Funding at $1.3B Valuation by SomeStupidPoint on Friday August 18, 2017 @03:38PM (#15049111)
Containers are how we managed to have something like five or six versions of Python in our production environment.
Re:Docker Is Raising Funding at $1.3B Valuation by subway on Friday August 18, 2017 @03:52PM (#15049220)
How do you apply security updates to 'five or six versions of Python' without losing your mind?
Re:Docker Is Raising Funding at $1.3B Valuation by SomeStupidPoint on Friday August 18, 2017 @05:19PM (#15049809)
You don't.

There's no good reason we should have had that many in production. We had three versions of the 2.X series and two versions of the 3.X series because of mixing-and-matching base images we used plus management deciding that we could do partial upgrades of Python version by upgrading a project at a time. (We switched from 2 to 3, which meant we had containers -- with different base images -- where we updated the 2.X version but not the 3.X version and containers where we updated the 3.X version but not the 2.X version. This gave us all kinds of mixes and matches of Python 2/3 versions.)

So I just hoped whoever was maintaining base images was actually maintaining their security patches, kept the versions we were intentionally using up to date during container construction, and it (mostly) just sort of worked out.

We're down to... 3 versions of Python and 3 base images. I'm trying to get down to 2 versions of Python (a 2.X and 3.X).

Re:Docker Is Raising Funding at $1.3B Valuation by rwmj on Friday August 18, 2017 @04:48PM (#15049613)
I can see two different versions being necessary (Python 2.x and 3.x), but is it really necessary to have versions other than the latest of each?
Re:Docker Is Raising Funding at $1.3B Valuation by imhoguy on Friday August 18, 2017 @03:07PM (#15048904)
With block/page level deduplication you can achieve even better results for VMs (ZFS, KSM etc). Containers can run on such setup too.
Re:Docker Is Raising Funding at $1.3B Valuation by xorcist on Friday August 18, 2017 @05:07PM (#15049730)
VMs are irrelevant because containers are not VMs.
Re:Docker Is Raising Funding at $1.3B Valuation by wpietri on Friday August 18, 2017 @05:27PM (#15049858)
Seems relevant to me. People have been using VMs for situations where they can now use containers.
Re:Docker Is Raising Funding at $1.3B Valuation by lllr_finger on Friday August 18, 2017 @02:45PM (#15048720)
Immutability, and consequently determinism, are wonderful traits to embrace when you're managing deployments across environments and regions for dozens or hundreds of services.
Re:Docker Is Raising Funding at $1.3B Valuation by eatmyshorts on Friday August 18, 2017 @05:47PM (#15050015)
And with testing...
Re:Docker Is Raising Funding at $1.3B Valuation by mmgutz on Friday August 18, 2017 @02:45PM (#15048716)
I had trouble understanding the benefits of it as well. A container is a snapshot of a specific version of an application/daemon and the OS it runs on all bundled into a deployable/runnable image. You create a container for every version of an app. Deploying or rolling back is almost as simple as deploying an image on any host that runs Docker.
Re:Docker Is Raising Funding at $1.3B Valuation by chrisper on Friday August 18, 2017 @02:48PM (#15048749)
There is also the fact that things stay inside a container (more or less). You want to remove mysql? No problem, just discard the container. Compare that to removing mysql and all its config files etc. from all over the place.
Re:Docker Is Raising Funding at $1.3B Valuation by sigjuice on Friday August 18, 2017 @06:24PM (#15050225)
The underlying problem is things like mysql that scatter things all over the place. Docker only encourages such sloppiness, IMHO.
Re:Docker Is Raising Funding at $1.3B Valuation by Godel_unicode on Saturday August 19, 2017 @01:53AM (#15051911)
While it might be true that MYSQL being a bad roommate is the core problem, does that matter? As an admin you don't get to ignore the pager because the outage is Oracle's fault.
Re:Docker Is Raising Funding at $1.3B Valuation by bognition on Friday August 18, 2017 @02:35PM (#15048636)
Its about creating and maintaining a clean environment. Conceptually they aren't that different than a VM just much lighter weight.
Re:Docker Is Raising Funding at $1.3B Valuation by dozzie on Friday August 18, 2017 @03:17PM (#15048969)
Except that it's not clean environment. Make it a properly built DEB or RPM package, and then we're starting (but just starting) to talk about clean.

Note also that binary packages help with repeatable deployment that uses Docker, deployment tools (e.g. Ansible or Salt), configuration management tools (CFEngine, Puppet), even manual -- and mix of all these. Docker images only help with Docker deployment.

Re:Docker Is Raising Funding at $1.3B Valuation by chrisper on Friday August 18, 2017 @02:46PM (#15048724)
Well, we need to differentiate between application containers (Docker) and Linux containers (old:openVZ, new:LXD/LXC). Then there are application containers which are even more "limited," like Flatpack.

I'd argue that only Linux containers are like VMs.

Re:Docker Is Raising Funding at $1.3B Valuation by imhoguy on Friday August 18, 2017 @03:14PM (#15048955)
Docker was LXC wrapper in the past. Now it just handles cgroup stuff itself. You can run full system in the Docker but purists regard this as antipattern.
Re:Docker Is Raising Funding at $1.3B Valuation by chrisper on Friday August 18, 2017 @03:19PM (#15048982)
I'd prefer LXD / LXC anyway. Sadly, LXD porting to Debian is a slow process.
Re:Docker Is Raising Funding at $1.3B Valuation by k__ on Friday August 18, 2017 @02:55PM (#15048795)
Docker users have essentially given up.

Nix[0] genuinely tries to solve the problem.

[0] https://nixos.org

Re:Docker Is Raising Funding at $1.3B Valuation by gaius on Friday August 18, 2017 @04:20PM (#15049415)
An interview question I asked recently: what are the advantages of Docker over an application deployed as a statically linked binary?
Re:Docker Is Raising Funding at $1.3B Valuation by mbrock on Saturday August 19, 2017 @09:53AM (#15053347)
I use Docker as a tool for creating statically linked binaries...

For example, here: https://github.com/mbrock/gf-static/blob/master/Dockerfile

Making static binaries is often extremely painful and confusing. It's easier on a distribution like Alpine, and nicely enough, Alpine comes as a Docker image.

In general, Docker's ability to basically spin up a whole Linux distribution, with a whole root file system, makes it very different from just using static binaries.

Along with Docker's image repository infrastructure, it makes some things easy that weren't easy before. Like, I don't know if there is a static binary build of the Erlang runtime system, and I don't know what kind of file system tree that system needs, but I just now opened an xterm and typed "docker run -it --rm erlang" and got an Erlang 9.0.2 shell.

Re:Docker Is Raising Funding at $1.3B Valuation by my_ghola on Friday August 18, 2017 @07:05PM (#15050441)
The same benefit of deploying a statically linked binary in a VM without the overhead of the VM.
Re:Docker Is Raising Funding at $1.3B Valuation by dopamean on Friday August 18, 2017 @04:22PM (#15049425)
What kind of answers do you expect/would like to hear?
Re:Docker Is Raising Funding at $1.3B Valuation by gaius on Friday August 18, 2017 @04:41PM (#15049566)
I intend it to be a starting point for a conversation, someone who really understands it will be able to convince the skeptic that I play, someone who is just typing the commands because it's trendy won't. Also it helps if they know what a statically linked binary is.
Re:Docker Is Raising Funding at $1.3B Valuation by fapjacks on Friday August 18, 2017 @05:11PM (#15049759)
It is obvious from your comments that nobody will convince you of any merit Docker has. You are not "playing a skeptic".
Re:Docker Is Raising Funding at $1.3B Valuation by gaius on Friday August 18, 2017 @05:19PM (#15049806)
I like containers as a concept, and I like the Docker commands for building them and running them locally. I am less convinced by Docker Swarm as a Prod-grade runtime environment, and skeptical that Docker the company can build a viable business out of something that will rapidly become a commodity, I expect the file format will long outlive the company that created it. But those are nothing to do with the question really, which can be answered purely technically.
Re:Docker Is Raising Funding at $1.3B Valuation by eatmyshorts on Friday August 18, 2017 @05:49PM (#15050027)
Curious--how do you feel about Mesosphere and Kubernetes vs. Docker Swarm?
Re:Docker Is Raising Funding at $1.3B Valuation by gaius on Saturday August 19, 2017 @02:47AM (#15052044)
Big fan of DC/OS. Ambivalent about k8s, but maybe it's just not for my use cases.
Re:Docker Is Raising Funding at $1.3B Valuation by brianwawok on Friday August 18, 2017 @05:11PM (#15049755)
Based on most interviews, he wants you to answer like he would answer or he wouldn't hire you.
Re:Docker Is Raising Funding at $1.3B Valuation by gaius on Friday August 18, 2017 @05:19PM (#15049811)
Did you just assume my agenda?
Re:Docker Is Raising Funding at $1.3B Valuation by meric on Friday August 18, 2017 @07:12PM (#15050475)
Binaries are built for specific operating systems. E.g. A Linux binary can't run on Mac OS X, except with a VM or... a container. :)
Re:Docker Is Raising Funding at $1.3B Valuation by AlphaSite on Friday August 18, 2017 @11:13PM (#15051454)
So are containers...?
Re:Docker Is Raising Funding at $1.3B Valuation by bonzini on Saturday August 19, 2017 @02:33AM (#15052004)
Indeed, Docker on OS X is actually running virtual machines through xhyve.
Re:Docker Is Raising Funding at $1.3B Valuation by moondev on Friday August 18, 2017 @05:05PM (#15049722)
Immutable infrastructure. And there should be no pain involved if the ci/cd pipeline is automated correctly.