Re:I don't think Elasticsearch is a good logging system
by rad_gruchalski on Tuesday September 28, 2021 @03:49PM
(#28686696)
I’d love to try your product out in combination with Jaeger. Is it possible?
Re:I don't think Elasticsearch is a good logging system
by toddpersen on Tuesday September 28, 2021 @04:38PM
(#28687192)
We've actually been doing some internal work with OpenTelemetry and Jaeger - we would love some feedback on it. Drop me a note at [email protected] and we can get you set up with a demo instance.
Former co-founder and CTO of InfluxData here, currently building a new company in this space. My strongly-opinionated view on this is that Elasticsearch is not a time-series database and asking it to handle large volumes of logs (fundamentally a time-series use case) is always going to be painful and expensive.
We've built a product called EraSearch that mimics the Elasticsearch APIs for ease of integration but is built with a significantly more efficient (read time-series) architecture. We can handle ingest volumes with about 1/10th of the hardware required for Elasticsearch while still offering comparable (or faster) query performance. If you are generating large amounts of logs (~1TB per day or more), my guess is that this will resonate with you.
If any of this sounds interesting, drop me a note at [email protected] - I'd love to hear more about your use case. Or even if you just want to talk about time-series data, I'm game. ;)
</shameless-plug>