News for hackers. Stuff that matters.
Re:Monorepos and Forced Migrations by orf on Tuesday October 12, 2021 @08:14PM (#28846710)
Isn’t that circular dependency kind of risky? What if a bad deploy knocks offline something required to complete the rollback process for that bad deploy?

I’m sure there are multiple layers of redundancy, but it seems like you could get into a Facebook style situation where you need to go open a (virtual) cage somewhere to flip a switch.

Re:Monorepos and Forced Migrations by dekhn on Tuesday October 12, 2021 @08:37PM (#28846860)
Yes, it's risky but given all the alternatives, it makes the least nonsense. It works because there is massive redundancy and datacenters aren't all updated at the same time.

When I worked at Google I worked in hardware platforms and I spent a lot of time working with hwops people, who have to go physically out to some server and press buttons (whilst chatting the results to me). If corp gmail, chat, and everything else was down, I might have some trouble getting in touch with those folks and verifying the right fixes (which is why the FB situation is so crazy).

Re:Monorepos and Forced Migrations by ramraj07 on Tuesday October 12, 2021 @09:35PM (#28847231)
Until something goes bad in a silly place like it did in Facebook and everything disappears everywhere for a good while. Because google is everything.