News for hackers. Stuff that matters.
Re:Kubernetes 1.10 released by linsomniac on Wednesday March 28, 2018 @10:57AM (#16698145)
One data point: I've wanted to but so far have not made much progress. I'd say my biggest impediment has been documentation: I can get it installed, but making it work seems to be beyond the scope of the documentation. I got closest once I found out about "kubespray" to install the cluster rather than using the official Kubernetes installation docs process.

I spent a couple weeks not quite full time going through tutorials, reading the documentation, reading blog posts and searching for solutions to the problems I was having. My biggest problem was with exposing the services "to the outside world". I got a cluster up quickly and could deploy example services to it, but unless I SSH port forwarded to the cluster members I couldn't access the services. I spent a lot of time trying to get various ingress configurations working but really couldn't find anything beyond an introductory level documentation to the various options.

Kubespray and one blog post I stumbled across got me most of the way there, but at that point I had well run out of time for the proof of concept and had to get back to other work.

My impression was that Kubernetes is targeted to the large enterprise where you're going to go all in with containers and can dedicate a month or two to coming up to speed. Many of the discussions I saw talked about or gave the impression of dozens of nodes and months of setup.

Other options I'll probably look at when I have time to look at it again: Deis https://deis.com/ , Dokku http://dokku.viewdocs.io/dokku/ , Flynn https://flynn.io/ , LXC https://linuxcontainers.org/lxc/introduction/ and (though I'd been trying to avoid it) Docker Swarm https://docs.docker.com/engine/swarm/

Re:Kubernetes 1.10 released by raesene9 on Wednesday March 28, 2018 @12:10PM (#16698924)
If you're looking for a better "out of the box" experience, I'd recommend having a look at OpenShift.

You can use either their free tier in cloud or use the Open source OpenShift Origin for trials (there's also MiniShift, which is similar to MiniKube).

From my looking at it OpenShift comes with some of the parts that base Kubernetes leaves to plugins, so things like ingress, networking etc are installed as part of the base.

Re:Kubernetes 1.10 released by andrewstuart2 on Wednesday March 28, 2018 @12:27PM (#16699131)
Are you trying to play around, or set up a working cluster? If you just want to play around, I'd suggest just using minikube to get things going.

Anecdotally, I got an HA cluster running across 3 boxes in the space of about a month, with maybe 2-3 hours a day spent on it. The key for me was iterating, and probably that I have good experience with infrastructure in general. I started out with a single, insecure machine, added workers, then upgraded the workers to masters in an HA configuration.

I don't think it is really that hard to get a cluster going if you have some infrastructure and networking experience, especially if you start with low expectations and just tackle one thing at a time incrementally.

Re:Kubernetes 1.10 released by oso2k on Wednesday March 28, 2018 @01:08PM (#16699568)
Full Disclosure: I work for Red Hat in the Container and PaaS Practice in Consulting.

At Red Hat, we define an HA OpenShift/Kubernetes cluster as 3x3xN (3 masters, 3 infra nodes, 3 or more app nodes) [0] which means the API, etcd, the hosted local Container Registry, the Routers, and the App Nodes all provide (N-1)/2 fault tolerance.

Not to brag, since we're well practiced at this, but I can get a 3x3x3 cluster in a few hours, I've lead customer to a basic 3x3x3 install (no hands on keyboard) in less than 2 days, and our consultants are able to install a cluster in 3-5 working days about 90% of the time, even with impediments like corporate proxies, wonky DNS or AD/LDAP, not so Enterprise Load Balancers, and disconnected installs. Making a cluster read for production is about right-sizing and doing good testing.

[0] http://v1.uncontained.io/playbooks/installation/#cluster-des...

Re:Kubernetes 1.10 released by andrewstuart2 on Wednesday March 28, 2018 @03:49PM (#16701230)
Worth mentioning that my "got a cluster working in a month" time frame includes starting with zero Kubernetes experience, and no etcd ops experience. Using kops, pretty much anybody can get a full HA cluster running in about 15 minutes. On top of that, it's maybe 5 more minutes to deploy all the addons you'd expect for running production apps on a cloud-backed cluster.

The great thing about automation is that once you have these basic tools (Prom/Graf monitoring/alerting, ELK, node pool autoscaling, CI/CD) implemented as declarative manifests, they're deployable anywhere in minutes.

Re:Kubernetes 1.10 released by merb on Wednesday March 28, 2018 @01:24PM (#16699749)
would be good if the "Enterprise Load Balancer" would just be another set of servers (with HAProxy + keepalived or something else, I love the "single ip" failover)

Edit: especially load balacing the master servers. (that's actually the hard part of k8s, not even setting it up with/out openshift/ansible whatever) load balancing services on k8s itself is basically just running either calico network and use one or two haproxy deployments of size 1 with a ip annotation or just using https://github.com/kubernetes/contrib/tree/master/keepalived...

Re:Kubernetes 1.10 released by user5994461 on Wednesday March 28, 2018 @03:38PM (#16701112)
One last challenge. Can you do all the setup without being root?
Re:Kubernetes 1.10 released by oso2k on Wednesday March 28, 2018 @06:44PM (#16702711)
As long the user can install packages (say, via /etc/sudoers file), make config changes, Yes. That's supported by our installer [0].

[0] https://github.com/openshift/openshift-ansible/blob/master/i...

Re:Kubernetes 1.10 released by linsomniac on Wednesday March 28, 2018 @04:29PM (#16701610)
I'm trying to set up a cluster in our development environment to play around with in preparation for rolling it to staging and production. So, minikube I have ruled out because it doesn't prove out the most critical parts of what we will need to run it in production.

I do have a lot of infrastructure and networking experience, it was mostly a matter of the ingress setup having many moving parts which were poorly documented. I could see that it had set up bridges and iptables rules and NAT and virtual interfaces, but I was never able to get a picture of how the setup was supposed to work to be able to see what parts of that picture were right or wrong.

There was no clear road-map of setting up a cluster. Most people talking about Kubernetes were doing "toy" deployments, which only had limited application to what I was doing. I only found kubespray because of a passing mention, for example.

I'd say your about right with a month. Had I given it another week or two, I probably would have gotten it going. I had really only expected it to take a couple days to have a proof of concept cluster, so at 2 weeks I was way beyond what I had slotted to spend on it.

Looking over the Getting Started Guide it looks very simple to get a test cluster set up. Which maybe set my expectations unreasonably high.

I guess that's what I'm trying to say: With the current state of documentation, it's probably a calendar month investment to get going.

Re:Kubernetes 1.10 released by digaozao on Wednesday March 28, 2018 @11:43AM (#16698594)
Take a look at rancher too. https://rancher.com/

Rancher 2.0 promises nice UI for K8s

Re:Kubernetes 1.10 released by oblio on Wednesday March 28, 2018 @01:28PM (#16699798)
Rancher 2.0 with Kubernetes. Should make things a lot easier.
Re:Kubernetes 1.10 released by piaste on Wednesday March 28, 2018 @12:30PM (#16699153)
Docker Swarm might be worth looking at regardless:

(1) it's like 15 minutes to learn how it works and then maybe a morning or so playing around with it. Very low investment.

(2) if you're already using docker-compose, it's pretty much an in-place switch. You might need to deal with a few restrictions (mandatory overlay network, no custom container names, no parameterized docker-compose), in exchange you'll get zero-downtime upgrades, automated rollbacks, and of course the ability to add more machines to your swarm.

Re:Kubernetes 1.10 released by egeozcan on Wednesday March 28, 2018 @12:21PM (#16699055)
Dokku is great if you want to deploy on a single machine. I've been happy with it so far and haven't been lucky enough to have a problem of scaling yet.