What you call a 'clusterfuck' is really a wider ecosystem. It would be pretty crazy for a single organization to use all or even most of the tools that you list.
Right now, people accept high degrees of cost (especially for at scale users) and lock-in, in exchange for the convenience of SaaS. Or, they go open source (which to your point, certainly is an investment in time)
Watch out for what team Grafana will be doing in 2017. Our plan is to provide a fully turnkey, hosted offering based around Grafana (and a handful of other open source tools). OpenSaaS.
We hope that for many users, this can be a third choice, and in some ways the best of both worlds.
Having nice graphs is nice... until they fall apart because the source is unavailable.
And that doesn't help with alerts either. (I tested the alerts in the v4 beta, it's just not comparable to the better alerting tools out there).
The alerting in v4.0 is just the beginning. Torkel and the team have tried to optimize for the “relatively simple" 80% of alert use cases.
We are fans of other, more sophisticated open source alerting tools like Bosun, and you can be sure that we'll be both improving our alerting capabilities in 4.x
Note: I am one of the maintainers of Diamond, a metrics collection tool written in python. https://github.com/python-diamond/Diamond
The OSS tools costs a fortune in human to maintain them, and another fortune in hardware to run it.
(I picked 600 because that was the approximate number of machines we had at my last job, where we used Graphite maintained by one guy, part time).
You included a LOT of redundancy in your OSS list. Multiple timeseries databases. Multiple collection daemons. Multiple dashboards. Multiple alerting systems (Who in their right mind would use Nagios AND Icinga?). You're effectively arguing about maintaining multiple monitoring stacks, some of which are quited aged.
Let's say statsd + collectd (metrics collection) + graphite (aggregation) + carbon/whisper (graphite storage) + icinga (alerting) + grafana (graphing). That doesn't exactly come easy.
No offense but a single graphite is not a monitoring solution. It's just the tip of the iceberg. Monitoring does take a lot of engineering work and a lot of maintenance. You won't get away operating 600 hosts on the cheap, just think about how much are the hosts themselves.
A typical system doesn't use all of the tools above. You use what fits you and many of the tools play pretty well together. I've had luck with Icinga2 and Grafana lately, for example, which integrated quite smoothly out of the box.
- customization will be very expensive, if not impossible
- you must have people for the procurement process (x10 more costly if you are in a gov agency),
- weird failures due to not finding the license,
- your cheap personal that install software won't be able to do it,
- you'll have problems creating testing environments because you don't have licenses
- you won't be able to do some things immediately because there aren't enough licenses.
And these are just the problems that came to my mind right now. All of them are real problems that I'd found in commercial software.
You've got a full API and integrations with a hundred different tools and services out of the box.
Seriously, my coworker was skeptic at first too (so was I). Then we configured the full integrations with AWS/the-agent/statsd/postgre/mysql/cassandra/elasticsearch/riak/nginx/haproxy/redis/memcache/pagerduty/slack and some more.
My co-worker concluded in front of my CEO, "it was 2 orders of magnitude faster [than anything else we've ever tried for monitoring]". And that's not even talking about the additional features and customization we couldn't even dream of.
> - you must have people for the procurement process (x10 more costly if you are in a gov agency),
True. That's the only major problem I can see: People who can't buy the software they need. That's a social problem, not a software problem.
> - weird failures due to not finding the license
It's only one API key to put in the agent config file.
> your cheap personal that install software won't be able to do it
I don't know who you're talking about. Monitoring has our best people working on it. At other places I've seen, it's done by devops consultants raking up £600 a day.
There is no cheap personal involved. (Maybe you're thinking about of cheap interns who add alerts? that's an anti pattern).
- you'll have problems creating testing environments because you don't have licenses
Same license. Put a tag environment=<environment> in the config and done, all metrics all servers and all alerts will be tagged.
- you won't be able to do some things immediately because there aren't enough licenses.
Not applicable. It's not a limited license by seats.
You pay the bill at the end of the month depending on the number of hosts in your package. There is a hourly price for ephemeral hosts and overrun.
I think having one pane of glass to do all passive monitoring tasks is an incredible step forward.
I am yet to see if the Active monitoring of Grafana is any good, but it does look very promising
- statsd
- collectd
- graphite
- whisper
- carbon
- prometheus
- grafana
- seyren
- riemann
- nagios
- icinga
- zabbix
There are multiple modern SaaS software that will do all of that in a single tool with better integrations, more polish, less work and no maintenance.
1) See https://www.datadoghq.com and last news https://techcrunch.com/2016/01/12/investors-feed-datadog-a-h...
2) https://signalfx.com/ and last news https://techcrunch.com/2015/03/12/signalfx-emerges-from-stea...
3) http://www.bmcsoftware.uk/it-solutions/truesight.html if you're not anti entreprisey (that was the "Boundary" startup, bought by BMC a few years ago and integrated in their offerings).
And don't think that they are "new" fancy tools. They've been around for many years.