News for hackers. Stuff that matters.
Re:Kubernetes at Home with K3s by stavros on Sunday December 05, 2021 @06:40AM (#29448549)
I wrote Harbormaster because I needed exactly this. It's very simple and has worked extremely well for me, at home as well as in production:

https://gitlab.com/stavros/harbormaster

Re:Kubernetes at Home with K3s by andrelaszlo on Sunday December 05, 2021 @07:35AM (#29448789)
I was just looking into Harbormaster. Does it play well with Traefik? Seems like a good combo in theory at least. I'm already running Traefik, but haven't found a nice way to automatically upgrade and make sure docker-compose is running for all projects I'm hosting.
Re:Kubernetes at Home with K3s by stavros on Sunday December 05, 2021 @08:07AM (#29448980)
Hmm, I've never used Traefik with it, I use Caddy in host mode. Does Traefik autodetect the containers from the Docker socket? I might look into it because that would make automatic ingress painless.

Harbormaster is basically a thin layer/manager over Compose. If Traefik works with a bunch of running containers, it'll work with Harbormaster.

Re:Kubernetes at Home with K3s by detaro on Sunday December 05, 2021 @08:54AM (#29449264)
> Does Traefik autodetect the containers from the Docker socket?

Yes, it can do that. you can put annotations(? tags? I forget what the docker terminology is) on containers that Traefik reads so it knows "expose port xyz on this container as https://example.com".

Re:Kubernetes at Home with K3s by stavros on Sunday December 05, 2021 @09:09AM (#29449344)
Hmm very interesting, I'll need to play with that and add annotation support on Harbormaster so it works out of the box, thanks!
Re:Kubernetes at Home with K3s by andrelaszlo on Sunday December 05, 2021 @02:07PM (#29451954)
That would be really cool. I might mess around with it around Christmas. If I run into any rough edges around labels (Traefik uses labels like `traefik.enable=true` https://doc.traefik.io/traefik/reference/dynamic-configurati...) I'll submit an issue or PR.
Re:Kubernetes at Home with K3s by stavros on Sunday December 05, 2021 @02:09PM (#29451971)
Excellent, thanks! I think a label config item should be enough to get Traefik working, but I'll know more after I look at it.
Re:Kubernetes at Home with K3s by codethief on Sunday December 05, 2021 @02:14PM (#29452043)
> Does Traefik autodetect the containers from the Docker socket?

Given the overall expertise you've demonstrated here on HN time and again, I'm sure you are aware of this but a general warning to everyone else reading this might be in order: Careful with exposing the Docker socket to Traefik, see https://github.com/traefik/traefik/issues/4174

Re:Kubernetes at Home with K3s by stavros on Sunday December 05, 2021 @02:28PM (#29452182)
Ah, yes, I'm unclear on whether Docker intends to be secure these days (though there are things like Sysbox or running rootless that help), but exposing the socket inside a root container is removing a few layers of defense, thank you for pointing this out.

Unfortunately I don't think there's a way for Harbormaster to do anything about it, but I'll play around with Traefik and see if there's a more secure way to deploy it, thank you.

Re:Kubernetes at Home with K3s by mrweasel on Sunday December 05, 2021 @06:56AM (#29448613)
Not really what I expected. I was thinking more in terms of a kubectl replacement, but this is actually pretty clever for the projects that want to run a git-ops setup.

Wonderful little project, thank you.

Re:Kubernetes at Home with K3s by stavros on Sunday December 05, 2021 @07:14AM (#29448695)
Oh hmm, how do you use kubectl for programmatic deployments? I've used it before but it required an intermediate machine with cluster access to run kubectl on, which is less convenient than git-ops.
Re:Kubernetes at Home with K3s by mrweasel on Sunday December 05, 2021 @07:34AM (#29448785)
We just use intermediate machines/jump-hosts :-)

It depends on the customer and the project. Most want git-ops, but often they also want kubectl. The overhead of having to build, instrument and manage the infrastructure to run software on a Kubernetes cluster is often a pretty big surprise for many of our customers. So in order to debug, developers still resort to kubectl to get a shell in a pod or viewing logs.

This is also why I'm against Kubernetes for most projects. It require a high level of maturity in the development team to do right. When you see some one who knows what they're doing, Kubernetes is amazing. For most people however, picking something more "classic" is going to make their life much easier. This is especially in the light of what most want is just some easy way to saying: "Run this container image on those two hosts".

So far the best solution I've been able to come up with is Ansible and AWX. Developers can then bump a version number in an group_vars file and click "launch" in AWX.

Re:Kubernetes at Home with K3s by stavros on Sunday December 05, 2021 @08:29AM (#29449111)
Ah yeah, this matches my experience 100%. Give Harbormaster a try, I think you'll like it. For me, it's exactly the simpler solution you mention.
Re:Kubernetes at Home with K3s by guywhocodes on Sunday December 05, 2021 @06:50AM (#29448586)
Interesting project, will give this a shot.