Re:Confluent, a company for Apache Kafka and realtime data
by easytiger on Friday November 07, 2014 @09:08AM
(#8572523)
How about a tiny forwarder on each device. It fopens the file and reads to the end, when the file is appended to it will be able to continue reading. Packet up each line and forward to you server using zeromq PUSH/PULL. If you are disconnected they queue up and send when zeromq automagically reconnects.
[ Parent
| on HN ]
Re:Confluent, a company for Apache Kafka and realtime data
by imperialWicket on Friday November 07, 2014 @12:33PM
(#8573601)
Since logstash was already mentioned, it's worth putting https://github.com/elasticsearch/logstash-forwarder here, as the logstash team built it as a solution for logstash-type needs on systems that may not be able to support logstash itself.