Re:Kustomize – Templating in Kubernetes
by marcinzm on Saturday April 20, 2019 @01:21PM
(#19707669)
I run a data infrastructure on terraform and kubernetes. Things it gives me out of the box:
* DNS. This lets all the various components talk to each other across nodes (Airflow, Spark, Zeppelin, etc.). I can also, via VPN, connect to things to look at what's going on.
* Load-balancing. I create pods and then they run on the node where there's capacity without me thinking about it.
* Auto-scaling. I spin up pods and nodes get created to handle the load.
* Helm charts for things so I don't have to figure out how to run them myself.
* Built-in support in the tools I use. Airflow will spin up k8s pods to run tasks. Spark will spin up pods to run a job. Etc.
* DNS. This lets all the various components talk to each other across nodes (Airflow, Spark, Zeppelin, etc.). I can also, via VPN, connect to things to look at what's going on.
* Load-balancing. I create pods and then they run on the node where there's capacity without me thinking about it.
* Auto-scaling. I spin up pods and nodes get created to handle the load.
* Helm charts for things so I don't have to figure out how to run them myself.
* Built-in support in the tools I use. Airflow will spin up k8s pods to run tasks. Spark will spin up pods to run a job. Etc.