News for hackers. Stuff that matters.
Re:Real-Time Log Collection with Fluentd and MongoDB by kordless on Monday December 05, 2011 @01:11AM (#3313395)
I'd also suggest looking at both Logstash and Greylog2. They both can use MongoDB as the storage engine for logs, and can also do the field extractions.
Re:Real-Time Log Collection with Fluentd and MongoDB by ashish_0x90 on Monday December 05, 2011 @06:04AM (#3314116)
FWIW, Graylog2 will be switching to ElasticSearch backend from the existing MongoDB, citing lack of performance constraints(and lack of better FTS functionality) specific to MongoDB. Find the entire comment here - http://groups.google.com/group/graylog2/browse_thread/thread...

This is something I am working on right now, which is to have a centralized logging system in place for the production servers. Logs will get indexed in ElasticSearch(pretty awesome project, imho!!), where I can run search queries against the indexes. I am using logstash for parsing, routing logs from production servers to elasticsearch instance.