News for hackers. Stuff that matters.
Re:We're Leaving Kubernetes by candiddevmike on Monday November 04, 2024 @10:36AM (#42042504)
You know that Cloud Run is effectively a Kubernetes PaaS, right?
Re:We're Leaving Kubernetes by richards on Monday November 04, 2024 @10:38AM (#42042525)
Google employee here. Not the case. Cloud Run doesn't run on Kubernetes. It supports the Knative interface which is an OSS project for Kubernetes-based serverless. But Cloud Run is a fully managed service that sits directly atop Borg (https://cloud.google.com/run/docs/securing/security).
Re:We're Leaving Kubernetes by dboreham on Monday November 04, 2024 @11:13PM (#42048545)
Parent said "effectively", which it appears you confirm.
Re:We're Leaving Kubernetes by bhouston on Tuesday November 05, 2024 @09:38AM (#42051755)
But it skips out on the Kubernetes part, which is the important part. :)
Re:We're Leaving Kubernetes by chanux on Monday November 04, 2024 @10:43AM (#42042566)
I guess the point is that for the OP, Kubernetes is now someone else's problem.
Re:We're Leaving Kubernetes by bhouston on Monday November 04, 2024 @10:40AM (#42042545)
> You know that Cloud Run is a Kubernetes PaaS, right?

Yup. Isn't it Knative Serving or a home grown Google alternative to it? https://knative.dev/docs/serving/

The key is I am not managing Kubernetes and I am not paying for it - it is a fool's errand, and incredibly rarely needed. Who cares what is underneath the simple Cloud Run developer UX? What matters for me is cost, simplicity, speed and understandability. You get that with Cloud Run, and you don't with Kubernetes.

Re:We're Leaving Kubernetes by davewritescode on Tuesday November 05, 2024 @08:01AM (#42051161)
I haven't looked at Cloud Run pricing but running Kubernetes in the cloud is pretty cheap these days and my experience with solutions like Cloud Run in the past is that they end up becoming expensive.

Kubernetes can be as complex or as expensive as you'd like but it's also fairly possible to run a pretty bulletproof simple Kube cluster.

Re:We're Leaving Kubernetes by bhouston on Tuesday November 05, 2024 @09:24AM (#42051673)
Maybe we misconfigured Kubernetes?

Here are my concerns:

With Kubernetes is that you need to pay for a few node just to keep it up, and then you need to pay for your nodes, no matter how much you use them.

Remember that Cloud Run charges based usage, so if a service sits unused for a while, which often happens in a heterogeneous microservices environment, you don't pay for it.

Also autoscaling is slow (Cloud Run autoscales really quickly, about as fast as your docker can be loaded and started, which for me is 1-3 seconds, where as I found Kubernetes auto-scales on the order of minutes) unless you over-provision, which is costly. This lets one scale to zero even without much of a hit.

I also ran into massive issues trying to get GPUs to work in Kubernetes - it was a driver nightmare that has wasted weeks of time collectively over the years. Whereas they are auto-provisioned properly on Cloud Run if you request them.

Lastly job systems on Kubernetes are a nightmare of configuration. The built-in scheduler cannot handle a lot of jobs but Argo also has its own issues if you actually try to use it. We've wasted weeks of effort on this. Cloud Run Tasks just skips this and is ultra fast too and handles scaling up to do a lot of jobs in such a simple fashion.

Honestly, managing Kubernetes is just overall a pain that has little benefit.

It is really hard to figure out what the benefits of Kubernetes is from my point of view. It has been a massive source of pain and costs and lost developer time.