News for hackers. Stuff that matters.
Re:What I Learned Managing Site Reliability for Some of the ... by toomuchtodo on Tuesday April 04, 2017 @08:33PM (#14038641)
> We were doing this with a team of sometimes one or two reliability engineers, but we were cheating, because our company culture meant that the engineers who built the systems are responsible for keeping them running, so they would invest their engineering time in fixing the problems along with us.

What advice would you give for an org where the engineers who build systems are not responsible for keeping them running, and everyone on a (much smaller comparatively) infrastructure team is (which is slowly turning into an SRE team by necessity)?

Anecdotally, I've found documentation to be useless; despite documentation being of a high quality, no one refers to it, even after iterating to continue to add information, make it more relevant, streamline, etc.

Re:What I Learned Managing Site Reliability for Some of the ... by jedberg on Tuesday April 04, 2017 @09:16PM (#14038850)
My advice would be to push as hard as you can to change the culture, or you'll be drowned. Engineers will not make it a priority to fix anything that causes outages because they will be evaluated on feature velocity, not uptime.

If you can make the company culture focus on uptime, or get engineers involved in remediation, then you'll be better off.

If you can't do that, try to at least push for the Google model: The engineers are responsible for uptime of their product until they can prove that it is stable and has sufficient monitoring and alerting, and then they can turn it over to SRE, with the caveat that it will go back to the engineers if it gets lower in quality.

Re:What I Learned Managing Site Reliability for Some of the ... by j_s on Tuesday April 04, 2017 @10:37PM (#14039212)
Or push to change the culture to match the one given in the article, where documentation is important and kept updated?
Re:What I Learned Managing Site Reliability for Some of the ... by toomuchtodo on Tuesday April 04, 2017 @10:26PM (#14039159)
Thanks for taking the time to reply, really appreciate the guidance.
Re:What I Learned Managing Site Reliability for Some of the ... by chimeracoder on Tuesday April 04, 2017 @08:51PM (#14038722)
> What advice would you give for an org where the engineers who build systems are not responsible for keeping them running

I don't think that's a healthy or sustainable culture for a company, certainly not one that's expecting to grow.

It might be sufficient for a company that has a small technical team and isn't looking to grow (think: the "tech department" for a company in another industry), but not for a company where engineering or technology is the primary focus.

Re:What I Learned Managing Site Reliability for Some of the ... by toomuchtodo on Tuesday April 04, 2017 @10:26PM (#14039161)
Thanks for the reply!