News for hackers. Stuff that matters.
Re:Confluent, a company for Apache Kafka and realtime data by gelliott on Friday November 07, 2014 @09:23AM (#8572575)
Can your endpoints log to syslog so they can be forwarded on to a central collector?
Re:Confluent, a company for Apache Kafka and realtime data by beagle3 on Friday November 07, 2014 @09:29AM (#8572603)
Probably. Do you know of a syslog/forwarder that deals properly with intermittent connections? (i.e., available for an hour, then gone for an hour, then available again, etc.)
Re:Confluent, a company for Apache Kafka and realtime data by b0ti on Friday November 07, 2014 @12:29PM (#8573581)
Not sure about logstash but a lot of its users use NXLog (http://nxlog.org) as a shipper since it has a much lower resource footprint as there is no java and ruby in there. (I'm affiliated with NXLog.)
Re:Confluent, a company for Apache Kafka and realtime data by otterley on Friday November 07, 2014 @02:13PM (#8574125)
Syslog-NG PE works well for this. It can be configured to use a per-destination disk buffer, so that if the destination goes offline, messages will queue until they can be sent again.