Re:Things I Wish I Had Known About Django Development Before...
by coolsunglasses on Wednesday April 17, 2013 @06:30PM
(#5567760)
Don't use celery use: https://github.com/binarydud/pyres
[ Parent
| on HN ]
Re:Things I Wish I Had Known About Django Development Before...
by mcintyre1994 on Wednesday April 17, 2013 @06:55PM
(#5567861)
I've been expecting to use Celery in a project I'm working on, could you explain why?
Re:Things I Wish I Had Known About Django Development Before...
by hobb0001 on Thursday April 18, 2013 @12:51AM
(#5568954)
Celery is brittle. If you stop a celery service, odds are, it will either not stop at all or leave stray child processes running.
It is not transactional, at least not with a MongoDB back-end. If you stop a celery service, any tasks that were in progress may or may not complete, but none of them will be picked up again when you resume.
No prioritization of queues or tasks. It is possible to set up separate services that handle different queues, but that's a PITA and there's still no guaranteed order of processing.
Re:Things I Wish I Had Known About Django Development Before...
by coolsunglasses on Wednesday April 17, 2013 @09:49PM
(#5568500)
Celery is a PITA and over-complicated for the problem it solves.
Re:Things I Wish I Had Known About Django Development Before...
by rozap on Wednesday April 17, 2013 @11:24PM
(#5568760)
Do you know why pyres relies on itty? Seems like kind of an odd dependency...
Re:Things I Wish I Had Known About Django Development Before...
by lost-theory on Thursday April 18, 2013 @11:04AM
(#5570993)
The pyres web interface (where you can view job status) is built using itty.
edit: looks like they're using flask now, I don't see itty being used anywhere. They also split the web interface (resweb) into a separate project, so pyres doesn't depend on a web framework now.
Re:Things I Wish I Had Known About Django Development Before...
by rozap on Thursday April 18, 2013 @12:33PM
(#5571529)
Ah ok, thanks. I guess the documentation is a little outdated then. Thanks for the suggestion, I'll check pyres out when I get to that point in my project.
Re:Things I Wish I Had Known About Django Development Before...
by the_cat_kittles on Wednesday April 17, 2013 @07:38PM
(#5568062)
considering the infrastructure that has built up around celery and particularly its use with django, i dont know why you wouldn't- care to explain?
Re:Things I Wish I Had Known About Django Development Before...
by dbarlett on Wednesday April 17, 2013 @08:48PM
(#5568314)
Pinterest replaced Celery and RabbitMQ [1] with their fork of pyres [2], presumably because it's 1/100th the codebase but does what they need to.
[1] http://highscalability.com/blog/2013/4/15/scaling-pinterest-...