News for hackers. Stuff that matters.
Re:The Evolution of Container Usage at Netflix by dominotw on Friday April 21, 2017 @09:50AM (#14165577)
> We implemented multi-tenant isolation (CPU, memory, disk, networking and security) using a combination of Linux, Docker and our own isolation technology.

Curious what their 'own isolation technology' does that docker doesn't.

Also, what does Fenzo do that marathon doesn't . Looks like Fenzo sits on top of marathon and sends it some sort of recommendations for scheduling. I need to find a good example of what this is actually doing.

Re:The Evolution of Container Usage at Netflix by lowbloodsugar on Friday April 21, 2017 @03:34PM (#14168666)
Fenzo is a java library for deciding how to allocate tasks when offered resources. It makes implementing Mesos frameworks easier because it turns out the question: "Given an offer of X resources, and a list of tasks that need running, what is the best use of the offered resources?" is actually quite hard. (3D knapsack hard).

"Apache Mesos frameworks match and assign resources to pending tasks. Fenzo presents a plugin-based, Java library that facilitates scheduling resources to tasks by using a variety of possible scheduling objectives, such as bin packing, balancing across resource abstractions (such as AWS availability zones or data center racks), resource affinity, and task locality." [1]

Marathon is a Mesos framework for scheduling long running applications (like rest services) and keeping them running. If what you want to do is serve http traffic then Marathon does the job (although the stand-alone UI is now deprecated and will only bug-fixed for "the next few months", so you'd better like the full DC/OS offering).

Titus appears to combine the functionality of Marathon, plus the ability to run batch jobs. I wondered if Titus was a fork of Marathon with new bits, but that doesn't appear to be the case. I believe it deals with one glaring flaw in Mesos, which is that frameworks all independently calculate the best use of the offered resources. When compute becomes available, Mesos makes offers to frameworks, with some basic logic such as making offers to frameworks currently consuming the least. But that means that there is no way to customize the resource allocation across different use cases (e.g. between REST APIs, one-off tasks and Spark clusters). It'd be great if Fenzo did "sit on top of Marathon", so I could customize how it schedules based on the "bigger picture". Titus avoids the problem because it schedules everything.

[1] https://github.com/Netflix/Fenzo

Re:The Evolution of Container Usage at Netflix by tyingq on Friday April 21, 2017 @11:31AM (#14166414)
>Curious what their 'own isolation technology' does that docker doesn't.

Probably related to that "and security" part. That isn't currently docker's strong suit.

Re:The Evolution of Container Usage at Netflix by skrater on Friday April 21, 2017 @09:55AM (#14165612)
Justifying high engineering salaries, i see this a lot in great companies.
Re:The Evolution of Container Usage at Netflix by colanderman on Friday April 21, 2017 @10:02AM (#14165691)
Netflix is the last place I'd expect to do this. They're famous for letting people go when they're no longer needed.
Re:The Evolution of Container Usage at Netflix by macNchz on Friday April 21, 2017 @11:17AM (#14166306)
That sounds like a great incentive to build big proprietary systems that depend on your presence...
Re:The Evolution of Container Usage at Netflix by draw_down on Friday April 21, 2017 @10:24AM (#14165855)
Yeah, boo on those evil developers who want to make money and work on interesting stuff. What are you, their CFO?