News for hackers. Stuff that matters.
Re:GitHub Outage by zymhan on Wednesday January 27, 2016 @08:21PM (#10985280)
I did that too. Destroyed out Zabbix database. Neither that Zabbix server, nor the other one monitoring the server I destroyed, could alert us that anything had gone wrong for over an hour. I finally realized it when I couldn't login...

I was able to painstakingly rebuild the server after 9 hours without anyone noticing. To this day one of my biggest fuck ups and prouder accomplishments.

Re:GitHub Outage by postila on Wednesday January 27, 2016 @09:12PM (#10985597)
Are you saying that once you break something, you should break your monitoring as well, but do it very quickly since it may be too late? :)
Re:GitHub Outage by zymhan on Thursday January 28, 2016 @10:23AM (#10988654)
Yeah, if you're going to break your monitoring solution, you'd better shoot it in the head and vaporize the body.