Bare-Metal Kubernetes with K3s

Re:Bare-Metal Kubernetes with K3s by sandGorgon on Tuesday December 22, 2020 @08:48AM (#25506185)

we are running k3s on metal in production. works great actually. we use haproxy as ingress and lb.

[ Parent | on HN ]

Re:Bare-Metal Kubernetes with K3s by polskibus on Tuesday December 22, 2020 @08:55AM (#25506269)

How stable do you see it ? What's your cluster size? How long has it been running? Any tips for how to approach starting such setup?

[ Parent | on HN ]

Re:Bare-Metal Kubernetes with K3s by sandGorgon on Tuesday December 22, 2020 @09:27AM (#25506530)

we scale up to about 100 machines. We use spot instances EXTENSIVELY. And that configuration was tricky actually. Its been a couple of months now. Works pretty ok.

k3s is actually pretty simple to use now. the tricky part was to integrate with https://github.com/kubernetes/cloud-provider-aws and https://github.com/DirectXMan12/k8s-prometheus-adapter

The hardest part is to get it to work with spot instances. we use https://github.com/AutoSpotting/AutoSpotting to integrate with it.

[ Parent | on HN ]

Re:Bare-Metal Kubernetes with K3s by venkyk on Tuesday December 22, 2020 @11:17AM (#25507783)

Wow! Impressive... what are the advantages over EKS? Just cost benefits or others as well?

[ Parent | on HN ]

Re:Bare-Metal Kubernetes with K3s by sandGorgon on Wednesday December 23, 2020 @12:47AM (#25514782)

We want to have the exact same stack running on laptops and cloud. That's the main goal. Everything else is secondary.

[ Parent | on HN ]