News for hackers. Stuff that matters.
Re:Why do we need Flask, Celery, and Redis? (2019) by acjohnson55 on Saturday April 18, 2020 @11:24AM (#22908356)
It may not make sense to retain jobs across deployments. What if the contract of the job is changed by the code being deployed? Might be easier to keep it all in-process, letting queues drain in a graceful shutdown.
Re:Why do we need Flask, Celery, and Redis? (2019) by mattbillenstein on Saturday April 18, 2020 @08:20PM (#22912297)
I haven't found that to be the case typically -- you could always serialize some information into the task to check for things like this.

Also consider if the machine running that process just disappears and that process dies. Putting work into a task queue allows you to do it durably until it can be processed so that it's not lost in some typical "that machine/instance died" scenario.

Re:Why do we need Flask, Celery, and Redis? (2019) by sateesh on Saturday April 18, 2020 @02:41PM (#22910040)
This might not be viable all the time, what if you have a stream of tasks being put to the queue ? The alternative would be to ensure that any change in the job contracts are backward compatible, and if any change in contract would need to have a remediation/migration plan for handling pending tasks.