Re:Kafka at the Low End
by wmfiv on Wednesday February 19, 2025 @10:39AM
(#43103242)
Work jobs in the order they were submitted within a partition key. This selects the next partition key that isn't locked. You could make it smarter to select a subset of the jobs checking for partition keys where all of the rows are still unlocked.
[ Parent
| on HN ]
Yes, something along the lines could work. But I am not sure if the above query itself would work if rows are appended to the table in parallel.
Also if events for a partition gets processed quick would the last partition get an equal chance?