Re:The end-to-end refresh of our server hardware fleet
by kuschku on Saturday March 11, 2017 @02:35PM
(#13846783)
> The only reason you don't see it is because there is a good chance that you are one of the lucky ones if you do things by yourself.
Or maybe because I have less complexity in my stack, so itβs easier to guarantee that it works.
Getting redundant electricity and network lines, and getting redundant data storage solutions is easy.
Ensuring that of 3 machines behind a loadbalancer at least 2 work is also easy.
Ensuring a complex system of millions of interconnected machines, services which have never been rebooted or tested in a decade (see the AWS S3 post-mortem), none will ever fail, is a lot harder.
Or maybe because I have less complexity in my stack, so itβs easier to guarantee that it works.
Getting redundant electricity and network lines, and getting redundant data storage solutions is easy.
Ensuring that of 3 machines behind a loadbalancer at least 2 work is also easy.
Ensuring a complex system of millions of interconnected machines, services which have never been rebooted or tested in a decade (see the AWS S3 post-mortem), none will ever fail, is a lot harder.