News for hackers. Stuff that matters.
Re:Things We Forgot to Monitor by aryastark on Monday February 10, 2014 @09:19PM (#7215289)
I think you're being obtuse.

Once you start sending emails for things, you start sending emails for everything. It's easy to fall into the trap of not accurately categorizing what is critical (like real, real, critical, I mean it this time guys!) and what are merely statuses. So what happens is everything starts being ignored, and your systems become obscure black boxes again.

Re:Things We Forgot to Monitor by hueving on Tuesday February 11, 2014 @01:27AM (#7216147)
I think you were the one being obtuse. There is no assumption that you will start receiving useless email status updates. In fact, most reasonable monitoring tools only email when a status changes to a problem state.
Re:Things We Forgot to Monitor by dredmorbius on Tuesday February 11, 2014 @02:53AM (#7216407)
most reasonable monitoring tools

20+ years of experience tells me most monitoring tools aren't reasonable.

Re:Things We Forgot to Monitor by hueving on Tuesday February 11, 2014 @09:04PM (#7222024)
Then don't use them? My point is that there is nothing wrong with email alerts, so the statement about them being a problem sounds like a misconfiguration or a failure to understand how to setup email filters.
Re:Things We Forgot to Monitor by dredmorbius on Wednesday February 12, 2014 @08:29PM (#7228756)
there is nothing wrong with email alerts

You're wrong.

As a sysadmin, I typically receive something on the order of 1,000 to 10,000 emails daily (the specifics vary by the system(s) I'm admining). Staying on top of my email stream is a significant part of my job, both in not ignoring critical messages which have been lost, misfiled, or spamfiltered, and in getting bogged down in verbose messages which convey no real information.

Alerts which tell me nothing have a negative value: they obscure real information, they don't convey useful information, and each person who comes on to the team has to learn that "oh, those emails you ignore", write rules to filter or dump them, etc.

Worse: if the alerts might contain useful information, that fact has to be teased out of them.

The problem with emails such as that is that they're logging or reporting data. They should be logged, not emailed, and with appropriate severity (info, warning, error, critical). Log analysis tools can be used to search for and report on issues from there.

As I said: in a mature environment, much of my work goes into removing alerts, alert emails, etc., which are well-intentioned but ultimately useless.

Re:Things We Forgot to Monitor by hueving on Thursday February 13, 2014 @12:01AM (#7229566)
>As a sysadmin, I typically receive something on the order of 1,000 to 10,000 emails daily

Sorry, but you're not a very good sysadmin then. You have chosen poor tools or do not understand how to distill the information. Knowing that, I can see why you think email alerts don't work. They are effectively broken FOR YOU.

Re:Things We Forgot to Monitor by ersii on Saturday February 15, 2014 @04:58PM (#7245537)
And you don't think vendors have a responsibility to reflect upon the way they do alerts and/or service monitoring?

It's usually not the system administrators that get to decide what the Corporate Overlords purchases or who they do business with. So I think it's pretty unfair to blame the admins for "choosing poor tools".