News for hackers. Stuff that matters.
Re:Lossless Log Aggregation - Reduce Log Volume by 99% Witho... by eastern on Friday December 06, 2024 @01:00AM (#42336835)
The obvious answer is a relational structure. In the given example, host, status, path and target should be separate relations. They'll all be tiny ones, a few rows each.

Of course, performance etc are a separate story but as far as the shape of the data goes, that's what the solution is

Re:Lossless Log Aggregation - Reduce Log Volume by 99% Witho... by LAC-Tech on Friday December 06, 2024 @01:40AM (#42337038)
Then you're locking your data into a relational model.

A log is universal, and can be projected to relational, document etc. Which is why most relational databases are built on top of them.