News for hackers. Stuff that matters.
Re:Riemann – A network monitoring system by dozzie on Tuesday January 19, 2016 @10:05AM (#10931189)
> Config file isn't a config file, it's an executed bit of Clojure code

For stream processing engines, configuration will be code. Unfortunate, but unavoidable.

> Riemann is not a replacement for an alerting mechanism

> Riemann is not a replacement for a trend graphing mechanism.

Indeed it is not. It's misadvertised as a monitoring solution, while it's a stream processing engine.

What I think of it is that you're supposed build a monitoring system on top of stream processing engine. It's a pity Riemann doesn't allow to subscribe to its streams from the outside, so to add any message destination you need to update its config.

Re:Riemann – A network monitoring system by AdamN on Tuesday January 19, 2016 @10:42AM (#10931425)
It seems like having a small tool to turn yaml files into basic clojure code for easy rulesets would be an easy extension. It might encourage Bad behavior and of course it couldn't do everything ... just an idea.
Re:Riemann – A network monitoring system by retrogradeorbit on Wednesday January 20, 2016 @12:33AM (#10936249)
That would actually be quite easy to do in clojure without the need for an external tool by writing a clojure macro that reads the other format and emits the s-expressions that represent it.
Re:Riemann – A network monitoring system by falcolas on Tuesday January 19, 2016 @10:42AM (#10931418)
> For stream processing engines, configuration will be code. Unfortunate, but unavoidable.

I honestly don't think it's unavoidable, so long as you separate the configuration (i.e. hosts, thresholds, outputs, etc) from your processing logic. Of course, this requires additional development work from within the "configuration" file.

Re:Riemann – A network monitoring system by dozzie on Tuesday January 19, 2016 @11:41AM (#10931834)
But for a stream engine the processing logic is configuration.

There aren't many examples of when code is a configuration parameter for service (generic RPC server for sysadmins being another example I've encountered), but there are some.

Re:Riemann – A network monitoring system by yid on Tuesday January 19, 2016 @09:36PM (#10935708)
> For stream processing engines, configuration will be code. Unfortunate, but unavoidable.

How so?

Kafka is a stream processing engine that uses plain old Zookeeper data structures for config.

Edit: Kafka also seems to have the missing features you mentioned if Riemann should be taken seriously as a general-purpose stream processing engine.

Re:Riemann – A network monitoring system by brian_cloutier on Tuesday January 19, 2016 @11:48PM (#10936140)
I would argue Kafka isn't a stream processing engine so much as a stream shipping engine. Kafka barely looks at the content of your messages.

I'd also argue that Zookeeper nodes are anything but "plain" :)

Re:Riemann – A network monitoring system by agentgt on Tuesday January 19, 2016 @10:38AM (#10931401)
That was my problem with Riemann. I love its core but I really want something built on top of it. Basically a Jenkins of monitoring (since clojure is JVM). I contemplated building it (ie taking Jenkins plugin system as inspiration) but it was just way to much work.
Re:Riemann – A network monitoring system by rhizome on Tuesday January 19, 2016 @09:41PM (#10935732)
Go any further than that and you have Yahoo Pipes or IFTTT