News for hackers. Stuff that matters.
Re:Queues Don't Fix Overload by notastartup on Wednesday November 19, 2014 @04:37PM (#8632758)
Can the problem be solved by using a fair queueing?

chunk off the overloaded queue into small groups and then have your workers chew a bit of each at a time. the LAST-IN folks won't have to wait ages for FIRST-IN folks to finish.

off topic but parisian french sounds way nicer than quebecois, the language of blue collar workers from 18th century, had to unlearn the horrible quebecois after high school.

Re:Queues Don't Fix Overload by lostcolony on Wednesday November 19, 2014 @05:37PM (#8633141)
Thank you for illustrating the reason for this blog post so perfectly.

The problem is not that the queue(s) aren't being accessed by workers fairly, but that requests are being dumped onto the queue(s) faster than the workers (or whatever your bottleneck is) can handle.

To stretch the metaphor, too often software devs respond with "Let's add more sinks (queues)!", rather than "let's add more drains, and make sure the ones we have are clean (identify the source of the bottlenecks and work to remove them/scale them)!". The first is comparatively easy, and seems to 'fix' the problem for a little bit; the latter requires measurement and careful architectural decisions, and possibly breaking changes.

Re:Queues Don't Fix Overload by danudey on Wednesday November 19, 2014 @05:14PM (#8633011)
It's not about queueing algorithm, it's about putting things into the queue faster than you're taking them out. Regardless of your algorithm's fairness, you're still going to have a queue that backs up until it overflows.