News for hackers. Stuff that matters.
Re:Grepping logs is terrible by regularfry on Wednesday May 06, 2015 @04:38AM (#9497268)
This is all well and good if you want to, and can, spend time up front figuring out how to parse each and every log line format which might appear in syslog so you can drop it in your structured store.

The alternative is to leave everything unstructured, and understand the formats minimally and lazily. Laziness is a virtue, right?

Re:Grepping logs is terrible by madhouse on Wednesday May 06, 2015 @06:25AM (#9497621)
Why would I need to be able to parse everything up front? Taking the syslog example, that has a commonly understood format. As a default case, I can just split the parts and have structured data (esp. with RFC5424, where structured data is part of the protocol to begin with).

Then, I can add further parsers for the MESSAGE part whenever I feel like it, or whenever there is need. I don't need that up front.

Re:Grepping logs is terrible by regularfry on Wednesday May 06, 2015 @09:50AM (#9498555)
Because in my experience, the interesting stuff isn't in the syslog metadata. It's in the message part. Until you add that further parser, you're grepping.