Re:Why Twitter didn’t go down: From a real Twitter SRE
by aftbit on Tuesday November 22, 2022 @11:05AM
(#33707233)
I once managed a cluster of worker servers with an @reboot cronjob that scheduled another reboot after $(random /8..24/) hours. They took jobs from a rabbitmq queue and launched docker containers to run them, but had some kind of odd resource leak that would lead to the machines becoming unresponsive after a few days. The whole thing was cursed honestly but that random reboot script got us through for a few more years until it could be replaced with a more modern design.
[ Parent
| on HN ]
There are no comments on this comment yet.