News for hackers. Stuff that matters.

A comment on OpenTelemetry at Scale: Using Kafka to handle bursty traffic. Parent comment

Re:OpenTelemetry at Scale: Using Kafka to handle bursty traffic by mirekrusin on Monday October 23, 2023 @03:20AM (#37982487)
Yes, it's good option but it requires serialised processing in partition scope, which may or may not be desirable.

If one-and-only-one semantics are needed and processing should be parallel, other methods have to be used.

[ Parent | on HN ]
Re:OpenTelemetry at Scale: Using Kafka to handle bursty traffic by robertlagrant on Monday October 23, 2023 @05:12AM (#37983283)
Presumably every exactly once processing scenario needs you to squeeze things through a serial pipe at some point, or you could have 2 messages with the same ID come in and be processed in parallel?
[ Parent | on HN ]
Re:OpenTelemetry at Scale: Using Kafka to handle bursty traffic by mirekrusin on Monday October 23, 2023 @05:45AM (#37983482)
Yes but scope/blocking/serialisation can be narrow or wide - ie. it can be per message id (highly parallel) or one for all messages of certain type/partition (not parallel).
[ Parent | on HN ]