News for hackers. Stuff that matters.
Re:Pitfalls of Helm – Insights from 3 yrs with the leading K... by aschleck on Thursday December 14, 2023 @11:01AM (#38642772)
I found that using "helm template" to convert every Helm chart into yaml, and then using Pulumi to track changes and update my clusters (with Python transformation functions to get per-cluster configuration) made my life so much better than using Helm. Watching Pulumi or Terraform watch Helm watch Kubernetes update a deployment felt pointlessly complicated.
Re:Pitfalls of Helm – Insights from 3 yrs with the leading K... by jpgvm on Thursday December 14, 2023 @11:06AM (#38642845)
I do the same with Tanka + Jsonnet, definitely a million times better than dealing with Helm itself or god forbid, letting it apply manifests.
Re:Pitfalls of Helm – Insights from 3 yrs with the leading K... by personomas on Friday December 15, 2023 @03:12AM (#38652093)
How does Tanka compare with Ksonnet? https://github.com/ksonnet/ksonnet
Re:Pitfalls of Helm – Insights from 3 yrs with the leading K... by jpgvm on Friday December 15, 2023 @03:50AM (#38652307)
The main thing is that it's still kicking, Ksonnet is sadly dead.

In addition to that it supports importing Helm charts, has a blessed convention for multiple environments and several native Jsonnet functions that make things a bit nicer.

Re:Pitfalls of Helm – Insights from 3 yrs with the leading K... by personomas on Friday December 15, 2023 @12:34PM (#38656419)
Interesting, thanks.
Re:Pitfalls of Helm – Insights from 3 yrs with the leading K... by notnmeyer on Thursday December 14, 2023 @11:13AM (#38642939)
i am hearing this more and more from folks.
Re:Pitfalls of Helm – Insights from 3 yrs with the leading K... by personomas on Friday December 15, 2023 @03:13AM (#38652099)
What about using terraform instead of Pulumi? Why did you pick Pulumi for this?
Re:Pitfalls of Helm – Insights from 3 yrs with the leading K... by aschleck on Friday December 15, 2023 @11:42AM (#38655846)
This is both a good thing and a bad thing, but Pulumi is way more flexible than Terraform. I wanted to have a cloud-provider-specific submodule that created resources (like EKS and GKE) that then exported output values (think kubeconfig), and then I wanted the parent module to pass those in as inputs to a cloud-provider-independent submodule. Terraform couldn't do it without needing to duplicate a ton of code, or without something heinous like Terragrunt (not sure it even would have worked.) Pulumi makes it trivial and in a language I like writing.

Additionally, our applications consume our cloud configuration (eg something that launches pods on heterogenous GPUs needs to know which clusters support which GPUs, our colo cluster has H100s but our Google cluster has A100s etc.) Writing in the same language in the same monorepo makes it very easy to share that state.

Re:Pitfalls of Helm – Insights from 3 yrs with the leading K... by totallywrong on Friday December 15, 2023 @08:45PM (#38661010)
With Pulumi you really are programming infrastructure in a language of your choice. HCL is a bad joke in comparison.