Ask HN: Fastest server log analyzer tool you use?

Posted by pezo1919 on Thursday June 11, 2020 @07:31PM
from the ask-hn dept.

Hi!

We are working on a blazing fast log analyzer tool for servers written in plain C.

I am wondering:

1. what are the known solutions you are using or are aware of in the industry?

2. what features/capabilities are a must have?

3. what features/capabilities are you missing and would like to see?

( 6 comments | 5 points | on HN )

Re:Ask HN: Fastest server log analyzer tool you use? by pezo1919 on Friday June 12, 2020 @05:46PM (#23504245)

OP here: we are focusing on aggregations/calculations, search query to find matching logs.

[ Parent | on HN ]

Re:Ask HN: Fastest server log analyzer tool you use? by divby0 on Friday June 12, 2020 @10:01AM (#23499297)

what do you mean specifically by log analyzer as this is a broad term. Parse the logs? Index the logs & do some aggregations/calculations? Do a search query to find matching logs?

[ Parent | on HN ]

Re:Ask HN: Fastest server log analyzer tool you use? by pezo1919 on Friday June 12, 2020 @05:44PM (#23504232)

Good question: we are focusing on these: aggregations/calculations, search query to find matching logs.

[ Parent | on HN ]

Re:Ask HN: Fastest server log analyzer tool you use? by divby0 on Sunday June 14, 2020 @11:42AM (#23518489)

Just curious why do you want it to implement it from scratch? Have you looked into this https://github.com/valeriansaliou/sonic if it helps?

[ Parent | on HN ]

Re:Ask HN: Fastest server log analyzer tool you use? by crazypython on Thursday June 11, 2020 @07:57PM (#23494502)

Sorry to hijack the thread, but why did you choose C instead of D? You can adapt your C program into D using a few find-and-replace searches, and you can #include arbitrary C headers (even Linux kernel headers) using DPP.

[ Parent | on HN ]

Re:Ask HN: Fastest server log analyzer tool you use? by pezo1919 on Friday June 12, 2020 @05:42PM (#23504220)

Technology familiarity. We know C and we are totally satisfied, we don't know D at all. :)

[ Parent | on HN ]