Re:Train Your AI Model Once and Deploy on Any Cloud
by jcims on Saturday July 08, 2023 @10:10AM
(#36644576)
Kubernetes gets a lot of shit on HN but for all of its challenges it has proven to be a fantastic method to abstract many of the idiosyncrasies of hosting on-prem vs various cloud providers. I've worked for two companies now with 8 figure monthly cloud spend and hundreds/thousands of applications operating in one or more of the main cloud providers and k8s has been essential in making that happen. Teams can migrate to an on-premise hosted option if they want, then transition to cloud if/when it makes sense, or just stay where they are.
[ Parent
| on HN ]
Re:Train Your AI Model Once and Deploy on Any Cloud
by stavros on Saturday July 08, 2023 @12:15PM
(#36645797)
Takes notes
"Kubernetes has been essential in making 8-figure monthly cloud spend happen"
Re:Train Your AI Model Once and Deploy on Any Cloud
by windexh8er on Saturday July 08, 2023 @12:28PM
(#36645932)
The last startup I was in was obsessed with putting everything into k8s for no apparent reason. Even the product they were selling, which most customers hated because it forced our customer base to either have to deal with the pain of paying for k8s because they had no need or intention to use it other than for our product or work with a cross-functional team which now created a time sink and dependency that wouldn't have been there otherwise.
The best though was when I ran across someone in the org trying to run a single container to run a periodic job in its own cluster. They spent half the day trying to get it to work with ingress.
You can imagine how it came to a head when the company realized they were spending hundreds of thousands per month on idle clusters in AWS.
Re:Train Your AI Model Once and Deploy on Any Cloud
by immibis on Saturday July 08, 2023 @01:47PM
(#36646793)
One company I worked at was obsessed with k8s for a while, on a local arrangement of about 4 servers, each build would start up a new container on kubernetes and rebuild an entire operating system from scratch.