News for hackers. Stuff that matters.

A comment on Octobot - A Low-Latency, Highly Parallel Distributed Task Queue Worker. Parent comment

Re:Octobot - A Low-Latency, Highly Parallel Distributed Task... by asksol on Monday September 20, 2010 @05:09PM (#1710513)
By the way the performance increase you're seeing with the PyInvoker (from your gist) is most likely because it doesn't have prefetch_count enabled.

Celery enables this so a single worker doesn't suck in a million messages at a time, and to balance the work load between available resources. As noted previously it can be disabled.

Btw, octobot looks great, maybe we can share ideas.

[ Parent | on HN ]
Re:Octobot - A Low-Latency, Highly Parallel Distributed Task... by cscotta on Monday September 20, 2010 @06:06PM (#1710672)
Right on, thanks Ask! I'm checking out some of this right now and might not be able to get through it all today, but will give it a try. Just shot you a couple messages outside of HN - love to talk when you have a chance!
[ Parent | on HN ]