News for hackers. Stuff that matters.
Re:FCC must reveal IP addresses and user-agent headers of ne... by kortilla on Monday May 04, 2020 @06:19PM (#23074044)
> Logs are designed to be parsed and searched

You’ve never dealt with a bad log setup. Things I’ve seen:

- inconsistent format depending on which part of the software was logging (think of some modules using logging lib and others using print())

- multiline logs without any indication they are multiline

- logs in some dumb binary format that requires the original software to reverse into legible text

There are more, but the point is that logs are not often designed to be parsed and searched. They are normally added by developers to be human readable means of reversing internal state to debug issues. Anything above that is (shockingly) bonus material that doesn’t make it into home-grown enterprise/govt software.

Re:FCC must reveal IP addresses and user-agent headers of ne... by ogre_codes on Monday May 04, 2020 @06:49PM (#23074297)
> You’ve never dealt with a bad log setup. Things I’ve seen:

I'm not sure how this is relevant. I've seen miles of incompetence in my career, that someone can fudge something up royally doesn't change the fundamental purpose of the thing. The point of log files is to store and make retrievable data about server state and actions over time. That someone somewhere can screw that up doesn't change that.

In this particular case, I find it unlikely they rolled some custom bizarro log file format regardless because of the nature of the subject matter: Proxy server log files. It's unlikely they rolled their own proxy server (and they certainly don't imply any particular difficulties like that in court statements) so we're most likely talking about reading standard Apache logs or something similar.

Re:FCC must reveal IP addresses and user-agent headers of ne... by kortilla on Thursday May 07, 2020 @12:52AM (#23099844)
> The point of log files

That’s a point of log files. However, it’s not the point tons of developers have in mind when they add log statements. Developers are primarily concerned with state required to reproduce bugs, not long term standardized storage containing enough information for useful attribution or even all important state transitions. You would be surprised how many developers don’t even bother logging item deletions because it’s such a trivial code path.

You’re idea of “the fundamental purpose” is from an operators view. It rarely lines up with the developers’ views and you’re in for a bad time if you think people who don’t see your perspective are “fudging something up royally” with “miles of incompetence”.

Re:FCC must reveal IP addresses and user-agent headers of ne... by jatone on Monday May 04, 2020 @07:11PM (#23074461)
uh they're text.... they don't need to be formatted well to be indexed and searched lol.
Re:FCC must reveal IP addresses and user-agent headers of ne... by kortilla on Thursday May 07, 2020 @12:53AM (#23099847)
Uh, you do know a field has to actually be present in a line for it to be indexed? And it has to be consistently formatted placed to be parsed lol.