News for hackers. Stuff that matters.
Re:Queues Don't Fix Overload by McGlockenshire on Wednesday November 19, 2014 @03:44PM (#8632495)
Take a look at Gearman. You get distributed background or foreground tasks with identifiers and optional queue persistence. Workers can also optionally report back their progress when working on a job. You can add and remove workers trivially at any time.
Re:Queues Don't Fix Overload by general_failure on Wednesday November 19, 2014 @03:59PM (#8632584)
Thanks for the pointer, I will investigate. Also found this: https://bugs.launchpad.net/gearmand/+bug/1150071