VictoriaLogs Practical Ingestion Guide for Message, Time and Streams

Re:VictoriaLogs Practical Ingestion Guide for Message, Time ... by nklmilojevic on Sunday August 17, 2025 @10:45AM (#44931939)

Amazing product. We use VictoriaMetrics for quite a while, and previously used Loki and our custom Clickhouse/Vector approach for logs and we have switched to VictoriaLogs. It is much better and faster than Loki, same goes with custom CH/Vector thing we had. Kudos to the team, we are waiting for VictoriaTraces to switch Tempo instance to it for opentelemetry stuff.

[ Parent | on HN ]

Re:VictoriaLogs Practical Ingestion Guide for Message, Time ... by CubsFan1060 on Sunday August 17, 2025 @12:27PM (#44932763)

Can you talk a little bit about your Victoria Logs setup? About how many logs are you ingesting and what kind of sizing do you have on your setup?

[ Parent | on HN ]

Re:VictoriaLogs Practical Ingestion Guide for Message, Time ... by nklmilojevic on Sunday August 17, 2025 @02:35PM (#44933792)

Sure thing!

Ingested logs 24h: 428 Mil Ingested bytes 24h: 625GB Inser req/s: 6k/s

8vCPU, 16GB mem. Running standard-rwo PVC on GCP.

We have a couple of projects like this with similar usage and similar machine sizing.

Still running vmlogs-single, and we will until we see a need to move to vmlogs-cluster version.

[ Parent | on HN ]

Re:VictoriaLogs Practical Ingestion Guide for Message, Time ... by camel_gopher on Sunday August 17, 2025 @04:17PM (#44934570)

That sounds like a lot of resources provisioned for 6k/s. 625GB/24hr is a small footprint.

[ Parent | on HN ]

Re:VictoriaLogs Practical Ingestion Guide for Message, Time ... by CubsFan1060 on Sunday August 17, 2025 @05:03PM (#44934922)

I would have said it sounded pretty good. What technologies are you comparing it against, out of curiosity.

[ Parent | on HN ]

Re:VictoriaLogs Practical Ingestion Guide for Message, Time ... by camel_gopher on Sunday August 17, 2025 @05:09PM (#44934969)

ClickHouse

[ Parent | on HN ]

Re:VictoriaLogs Practical Ingestion Guide for Message, Time ... by CubsFan1060 on Sunday August 17, 2025 @06:28PM (#44935499)

Can you share any additional details? What kind of ingestion do you have, with what dimensions of a clickhouse cluster?

I'm also curious how it handles structured vs unstructured logs.

Thanks!

[ Parent | on HN ]

Re:VictoriaLogs Practical Ingestion Guide for Message, Time ... by CubsFan1060 on Sunday August 17, 2025 @05:04PM (#44934929)

That seems pretty good. Do you have any sort of HA solution?

[ Parent | on HN ]

Re:VictoriaLogs Practical Ingestion Guide for Message, Time ... by PaywallBuster on Sunday August 17, 2025 @02:02PM (#44933541)

personally Hetzner SX295 that has 14x 22 TB on a ZFS setup

It ingests 70k lines per second without a sweat

reads are just as fast

[ Parent | on HN ]