mchmarny

GPU Kubernetes is hard. Aligning kernels, drivers, container runtimes, operators, and Kubernetes versions is a version compatibility minefield. A single misconfigured component can take down an entire GPU fleet, and root cause analysis can take days. Typically, these known-good configurations live as tribal knowledge in “runbooks” and internal pipelines, not as portable, reproducible artifacts.

The recently open-sourced AI Cluster Runtime (AICR) project is designed to solve that friction. It provides optimized, validated, and reproducible configurations for a given GPU-accelerated Kubernetes cluster.

Keeping a GPU cluster healthy at scale isn't just a "nice to have"—it’s the difference between seamless training and a nightmare of idle nodes. That’s why we built NVSentinel, our open-source system designed to detect, classify, and auto-remediate hardware and software faults across Kubernetes nodes and NVSwitches.

If you have an option to containerize the app, Jib may be what you are looking for. Plugs into Maven, and the same source/content always generates the same image - https://github.com/GoogleContainerTools/jib

The amount of dependancies, build environment setup steps, across all of the components, and sheer complexity of putting the entire stack together from scratch, would exclude a substantial portion of the target users... hence, while possible, is not reasonable, certainly not on angling basis.

“But each layer here adds an element of required trust”, how often we simply glance over that and assume. In the same time, building everything from source is also neither reasonable nor 100% secure. Glad smart people like Dan are looking into this.

Based on the write up it seems that the author could benefit from the fully managed version of Cloud Run on GCP (https://cloud.run). No cluster to manage would help with maintenance pains and per request billing model could potentially lower the overall costs given the scale to 0 capability.

Every couple of months I search for a better news reader… cycle through Flipper, Feedly, NewsBlur, & 4-8 others… once more acknowledge how good Google Reader really was, and go back to scrolling through Twitter/Reddit

I’d probably pay large amount of money now for a news reader w/ these 4 features * Extract stories from my feed/lists on Twitter & Reddit and aggregate comments on these from people I follow * Learn from my ‘more/less like this’ on individual stories * Allow me to tag sources and create auto-tagging filters * Clean/intuitive Web UI & mobile client

It’s exciting to see ecosystem build commercial products using Knative (https://github.com/knative). The developers on those platforms benefit from increased portability. Congratulations to the riff team behind the new Pivotal Function Service offering

I wrote a little post to explain why Knative is important from the developer perspective https://medium.com/@mchmarny/build-deploy-manage-modern-serv...

this could be interesting, especially if from the trenches, supported by real-life scars (experiences)