Kafka at the Low End

Re:Kafka at the Low End by lmm on Tuesday February 18, 2025 @08:47PM (#43097594)

Kafka. If your load is low enough for the problem described in the article to happen, your load is low enough that it's not an issue.

[ Parent | on HN ]

Re:Kafka at the Low End by xmcqdpt2 on Wednesday February 19, 2025 @09:38AM (#43102584)

I'm not sure you understood the article. You can have a very low load but each task on your queue takes a while to process, in which case you want fair distribution of work.

[ Parent | on HN ]

Re:Kafka at the Low End by lmm on Wednesday February 19, 2025 @08:07PM (#43109908)

The distribution is fair - everything is round-robin, so in the long run each worker receives the same rate of tasks. It's just "lumpy" - sometimes you can get a big batch sent to one worker, then a big batch sent to another worker - but it will all average out.

[ Parent | on HN ]