News for hackers. Stuff that matters.
Re:Real-time notifications from systemd to Slack by notheguyouthink on Monday March 13, 2017 @09:20AM (#13857538)
What would you suggest? We're in need of an alerting platform and making use of Slack, not because it's flawless or anything, but because we're already paying for it and it's convenient for the mass junk. Ie, not strictly mission critical alerts.

What medium might be better than Slack?

(to be clear, i'm asking, not saying Slack is good for this)

Re:Real-time notifications from systemd to Slack by amyjess on Monday March 13, 2017 @11:26AM (#13858585)
Zabbix. It's open-source and pretty flexible. I maintain my company's Zabbix installation, and I've come to appreciate it (and 3.x finally has a non-ugly UI!).
Re:Real-time notifications from systemd to Slack by lima on Monday March 13, 2017 @11:41AM (#13858752)
We use Nagios + CheckMK, but I believe neither this nor Zabbix solve the alerting part.

Our solution is a custom notification broker that decides whom to alert and then waits for an acknowledgement. It uses different backends including our company chat.

Not complicated at all, just 100 lines of Python code that contain the business logic.

Anything that relies on a single medium is unsuitable for anything but unimportant alerts. What if Slack goes down for 2 hour? Unlikely, but definitely possible.

This ensures that every alert is explicitly acknowledged by someone, and that unimportant alerts are quickly forgotten without wondering whether someone handled them or not.

We have different applications sending alerts, not just Nagios (because Nagios sucks at processing events as opposed to states), and it would quickly become unmanageable without some sort of middleware.

Re:Real-time notifications from systemd to Slack by daveguy on Monday March 13, 2017 @01:51PM (#13860380)
Is it something where the business logic part could be easily abstracted / separated? It sounds like an interesting and useful yet simple tool. The open source community can always use more of those.

Edit: or maybe something like a blog post to describe the structural details.

Re:Real-time notifications from systemd to Slack by lima on Monday March 13, 2017 @03:33PM (#13861494)
Would need some clean-up but sure, why not. Ask again in a month or so :)