News for hackers. Stuff that matters.
Re:Train Your AI Model Once and Deploy on Any Cloud by oceanplexian on Saturday July 08, 2023 @11:12AM (#36645156)
> Kubernetes means you don't have to learn each clouds way of doing a deployment.

So instead of learning how to deploy on GCP, AWS, and Azure, which is only 3x more complicated than deploying to a single cloud, you should learn K8s, which is 10-15x more complicated, in addition to still having to learn about all the various ingress controllers and weird quirks that are completely different on each cloud provider. Doesn't really track for me.

Re:Train Your AI Model Once and Deploy on Any Cloud by echelon on Saturday July 08, 2023 @11:38AM (#36645406)
> which is 10-15x more complicated

You can learn k8s in a day. It's really simple.

> various ingress controllers and weird quirks that are completely different on each cloud provider

Which are thoroughly documented and not that hard to implement or understand. You'd be reading about each cloud's nonstandard ingress even without k8s.

The beauty of k8s is you can run your software locally and have a much easier time lifting and shifting to another cloud.

Fitting to the shape of a cloud provider is a great way to never leave.

Another benefit of k8s is that you treat your services as cattle you can easily spawn and kill. Adoption of k8s naturally leads to anti-fragility, anti-brittle best practices.

Re:Train Your AI Model Once and Deploy on Any Cloud by hosh on Saturday July 08, 2023 @12:36PM (#36646049)
I think being able to abstract the cloud providers is secondary to k8s’s ability to self-heal and its modularity.

But I think most developers don’t care, and instead, should interact with a platform built with Kubernetes as a foundation.

Re:Train Your AI Model Once and Deploy on Any Cloud by profunctor on Saturday July 08, 2023 @04:33PM (#36648442)
Maybe this is because I’m not that smart but I could not learn real kubernetes in a day. I had to build a system for loading models and returning predictions over a HTTPS api. It had to connect to storage to load the model, needed secrets etc. It took more than a day. And I think it would take most people more than a day to go from zero to able to create a useful, real world deployment in a day. I’m sure you can rush through the documentation in a day but I wouldn’t call that learning.
Re:Train Your AI Model Once and Deploy on Any Cloud by bg24 on Saturday July 08, 2023 @06:54PM (#36649592)
Having spent 4 years working with kubernetes (though as a PM, but pretty hands-on), getting started is easy - like in less a week. The problem happens when you run into issues. That can suck up lot of time. Also if you are new to containers, it might not be a good step to venture into k8s.
Re:Train Your AI Model Once and Deploy on Any Cloud by hosh on Saturday July 08, 2023 @12:33PM (#36646013)
K8S is not that complicated. Once you know the big ideas behind it, and how to reason with it, it becomes a very versatile platform substrate.

Probably the biggest one is understanding you don’t ever do anything directly with Kubernetes.

Re:Train Your AI Model Once and Deploy on Any Cloud by el_benhameen on Saturday July 08, 2023 @01:37PM (#36646677)
Do you have any favorite learning resources?
Re:Train Your AI Model Once and Deploy on Any Cloud by doctoboggan on Saturday July 08, 2023 @03:58PM (#36648135)
I've learned K8S over the past few months and what was absolutely instrumental to my understanding was: 1. use Helm, and 2. daily chat sessions with gpt-4.

I use gpt-4 through the API where you can set your own system prompt. I developed one that basically instructed it to give me kubectl commands to solve my problems and then wait for me to give it the result before continuing. Through this I learned the practical techniques and which kubectl commands you use on a daily basis, which is so much more helpful than reading the documentation which just gives all commands equal weight.

EDIT: Oh, and definitely watch a few "TechWorld with Nana" videos on YouTube. She does a great job of explaining the architecture, terminology, and philosophy of k8s which I think it very helpful to know.

Re:Train Your AI Model Once and Deploy on Any Cloud by hosh on Sunday July 09, 2023 @09:38AM (#36654360)
I learned k8s the hard way so I am not sure I can point those out.

That mindset of not doing anything directly comes from understanding that you are not setting up pods up, but rather, you are setting automated processes up. These processes knows what the desired state is, and if there is something that changes things, it takes actions to get back to that desired state.

So you don’t create pods. You create deployments that maintain a set of pods. You don’t assign pods to nodes. You define pod affinities, and use node selectors on nodegroups. You use pod priority. You make graceful startups and shutdowns work correctly. And so forth.

Re:Train Your AI Model Once and Deploy on Any Cloud by saurik on Sunday July 09, 2023 @04:02AM (#36652570)
Then what are you using, if not kubernetes, when you are using kubernetes?
Re:Train Your AI Model Once and Deploy on Any Cloud by hosh on Sunday July 09, 2023 @09:44AM (#36654403)
You don’t use kubernetes. You’re defining desired states for various processes that are collectively called “Kubernetes”. These automated processes maintain things at the desired state, and take action to move things back to the desired state when that happens. These processes are distinct, and are not usually aware of each other (example: horizontal pod autoscaling and cluster autoscaler).

If you understand that, you then know you can add processes (such as operators or the cluster autoscaler).

It’s a mindset shift. Thinking of it as “using” kubernetes, as if it is a monolithic thing that you directly control, will greatly increase the difficulty in understanding and reasoning through what’s going on within a Kubernetes cluster.

Re:Train Your AI Model Once and Deploy on Any Cloud by ithkuil on Sunday July 09, 2023 @04:15AM (#36652638)
A lot of people conflate the pains of installing and managing the kubernetes "infrastructure", with the pains of deploying and managing an application running on kubernetes.

The complaints are real, because in practice a company needs both aspects and when a small company struggles to setup and manage the kubernetes infrastructure correctly, the application operators are suffering the consequences (e.g. log collection infrastructure doesn't work, it's hard to provision nodes with the right capacity, things like that). They see the infrastructure operation team struggle and they partake in that struggle because what is advertised to be easy, it's not.

That said, K8s is a very good way to build an "API" between infrastructure and application "teams". It can work very well if the people involved set things and processes up correctly. It can be a nightmare if botched up

Re:Train Your AI Model Once and Deploy on Any Cloud by hosh on Sunday July 09, 2023 @09:29AM (#36654302)
> That said, K8s is a very good way to build an "API" between infrastructure and application "teams". It can work very well if the people involved set things and processes up correctly. It can be a nightmare if botched up

Agreed.

Someone has to actually build it with a product mindset — including product-market fit. I’m one of those oddballs that have set up and scaled up infra, and have put together and delivered applications before.

In one gig, I had people joke about naming what I had setup after Heroku. I didn’t realize its significance until I came to a place where it was not done this way. Many on the application team have expressed dissatisfaction… but it’s like the infra team is oblivious to that.

Re:Train Your AI Model Once and Deploy on Any Cloud by beebmam on Saturday July 08, 2023 @05:38PM (#36649028)
No shot that kubernetes is 10-15x more complicated than cloud offerings.
Re:Train Your AI Model Once and Deploy on Any Cloud by ChatGTP on Sunday July 09, 2023 @07:50AM (#36653711)
There is no way k8s is that complicated? Not sure you’ve used it in anger but it is awesome.