Re:Post Mortem of Google Outage on 14 December 2020
by bbarnett on Saturday December 19, 2020 @08:54AM
(#25477399)
With bare metal, you just have to roll your own monitoring.
Primarily, only buy what you can work with easily. Mainly, esure raid monitoring can be scripted, and you really need not depend upon the manufacturer's horrid software (which I agree is just that). A bit of IPMI for failed power supplies, or what not. If a box dies, it dies, that's what failover is for.
I don't your logging complain, you need it no matter what you do. Just use an rsyslog server, logcheck or other app, monitor for important events, done. I've never used anything off the shelf, and yet all I hear are complaints from those that do.
I get how people might want to eschew the above for simple stuff, but once you start needing heavy monitoring, it's all the same ball of wax.
The dinosaurs of the on-prem hardware world like Dell, HPE and IBM make the most atrocious systems management software that I have ever seen. Bargain basement quality at best.
The cloud is eating their lunch for a reason.
Everyone wants a single pane of glass, not a hundred unique and special vendor-specific consoles to manage one app.
Everyone wants unified logging built-in, not Splunk on top of fifty different log formats, none of which can be easily correlated with each other.
Everyone wants a unified IAM system, nobody likes to deal with expired SAML or LDAP certificates in the middle of a change.
Etc, etc...
Compared to having to deal with 10 different teams just to spin up a single VM and 15+ teams for a moderately complex application with HA/DR and monitoring, being able to simply click through a cloud portal is an absolute joy.
It's the same thing that made VMware so popular. Nobody liked to have to get finance involved and order new kit six weeks ahead just to be able to spin up a tiny web server.