Re:Kubernetes the Hard Way – Vagrant, Ansible, No Cloud
by ok_dad on Monday March 04, 2024 @01:21PM
(#39593916)
Yea, I used some bash scripts to manage ~250 rack mounted servers running Linux with a bunch of custom kernel shit. I don’t even remember everything it did but they specifically couldn’t use virtualization with this system due to latency and only the software included with the OS distribution was allowed so no Ansible or anything.
Re:Kubernetes the Hard Way – Vagrant, Ansible, No Cloud
by ok_dad on Monday March 04, 2024 @02:30PM
(#39594862)
Yea, we were only allowed the tools on the ISO of one specific distribution even for the workstations! It was a secure closed network for testing stuff. My scripts were probably just a worse ansible. Occasionally I would threaten the servers aloud that I would “beat them with a stick” if they misbehaved, because I had a special USB stick which I would use to boot a mini distro that would format the server and pull the approved install image down and setup the network and stuff. It was easier to do that when something hung than diagnose it.
Re:Kubernetes the Hard Way – Vagrant, Ansible, No Cloud
by dijit on Monday March 04, 2024 @01:41PM
(#39594199)
Hrm, I have a repo like this for comparing Nomad and Agones.
I even have inspec profiles to test everything and it even supports windows (agones is teaching kubernetes to run gameservers so Windows and Gameservers is common)
Honestly I spent a good chunk of a month working on it, if there is any actual interest I could release it but I dont think anyone has the same problems I do.
Re:Kubernetes the Hard Way – Vagrant, Ansible, No Cloud
by INTPenis on Monday March 04, 2024 @01:46PM
(#39594260)
This is the only way for me. I generally have one repo for Terraform to provision the k8s nodes, wherever they may live, and another with Ansible to provision the k8s services and some basic operators like observability stack for example.
But now I'm moving more into using atomic server OS so I'm doing everything in one Terraform repo with ignition (or cloudinit).
Re:Kubernetes the Hard Way – Vagrant, Ansible, No Cloud
by nunez on Monday March 04, 2024 @08:43PM
(#39598469)
getting kubernetes up and running is crazy easy these days, but this is still THE way to learn Kubernetes inside out. i wouldn't recommend doing this for production though unless you want to manage k8s as your day job.
Does bring back memories of working with Docker in the early days though.
IIRC, Ansible, unlike Puppet or Salt, didn't require anything particular provisioned on the server - just old good SSH.
I starred this awhile back, it’s the really hard way imo, really great for learning: https://github.com/ghik/kubernetes-the-harder-way
I even have inspec profiles to test everything and it even supports windows (agones is teaching kubernetes to run gameservers so Windows and Gameservers is common)
Honestly I spent a good chunk of a month working on it, if there is any actual interest I could release it but I dont think anyone has the same problems I do.
But now I'm moving more into using atomic server OS so I'm doing everything in one Terraform repo with ignition (or cloudinit).
Or the expensive way, which is also the hard way.