News for hackers. Stuff that matters.
Re:Vector: A high-performance observability data pipeline by miller_joe on Sunday March 17, 2024 @08:31PM (#39739362)
Vector is fantastic software. Currently running a multi-GB/s log pipeline with it. Vector agents as DaemonSets collecting pod and journald logs then forwarding w/ vector's protobuf protocol to a central vector aggregator Deployment with various sinks - s3, gcs/bigquery, loki, prom.

The documentation is great but it can be hard to find examples of common patterns, although it's getting better with time and a growing audience.

My pro-tip has been to prefix your searches with "vector dev <query>" for best results on google. I think "vector" is/was just too generic.

A nice recent contribution added an alternative to prometheus pushgateway that handles counters better: https://github.com/vectordotdev/vector/issues/10304#issuecom...

Re:Vector: A high-performance observability data pipeline by dan-robertson on Sunday March 17, 2024 @08:56PM (#39739520)
What volume of data do have going through this process, roughly?