News for hackers. Stuff that matters.
Re:Celery in production: Three more years of fixing bugs by gregsadetsky on Saturday March 05, 2022 @08:51PM (#30574193)
What would you recommend instead?
Re:Celery in production: Three more years of fixing bugs by wryun on Saturday March 05, 2022 @10:30PM (#30574782)
I'm also in the 'anything but Celery' camp:

https://dramatiq.io/motivation.html

If you're backing onto something like SQS or Rabbit (Redis is a bit trickier), it's not the worst thing to hand-roll either. Then you understand exactly what trade-offs you're making.

Re:Celery in production: Three more years of fixing bugs by ungawatkt on Saturday March 05, 2022 @08:59PM (#30574255)
I had a good time with dramatiq+apecheduler, much more bare bones and less out of the box, but when something went wrong is was pretty easy to understand and work around.
Re:Celery in production: Three more years of fixing bugs by staticautomatic on Saturday March 05, 2022 @09:07PM (#30574316)
Dramatiq is great.
Re:Celery in production: Three more years of fixing bugs by akvadrako on Sunday March 06, 2022 @04:28AM (#30576246)
For under 1000 messages per second, PostgreSQL is great at queues.
Re:Celery in production: Three more years of fixing bugs by rtpg on Sunday March 06, 2022 @03:53AM (#30576102)
We have transitioned over to Dramatiq.

It has its own set of problems (mostly from starting at the set of "we will remove all of Celery features" and then going from there), in particular its logging policies are extremely frustrating and we have had to work around them. But the code is so simple in general that we get good compensation for that.

I personally would have liked to use dq instead but that's mostly an aesthetics thing.

Re:Celery in production: Three more years of fixing bugs by porker on Sunday March 06, 2022 @02:40AM (#30575767)
Beanstalkd?

These comments say better than I can why I like it

https://news.ycombinator.com/item?id=27483167

https://news.ycombinator.com/item?id=24714198

Re:Celery in production: Three more years of fixing bugs by 411111111111111 on Sunday March 06, 2022 @03:30AM (#30575993)
Celery is not a broker daemon, it's an abstraction for them. You can use it with various brokers and some kv databases such as redis.

And yes, celery also supports beanstalk, so it's clearly not an alternative to it

http://docs.celeryproject.org/en/latest/getting-started/brok...

Re:Celery in production: Three more years of fixing bugs by johtso on Sunday March 06, 2022 @04:51AM (#30576318)
Currently exploring using arq, a successor to rq for my next project.