Re:Serverless at Scale: Lessons from 200M Lambda Invocations
by insanitybit on Sunday November 12, 2023 @12:11PM
(#38242055)
> We brought down our whole compute cluster once when someone ran update and it changed some stupid thing
I've seen this happen twice now, as well.
Re:Serverless at Scale: Lessons from 200M Lambda Invocations
by buffet_overflow on Sunday November 12, 2023 @05:29PM
(#38244762)
I feel like we’re close to that with automated testing and rollbacks. Still, it seems like a ton of complexity for what feels like a fundamental need
It will happen to you sooner or later also. Updates are always out of band for this reason.
That’s why everybody does builds and isolates isolates updates to that process.