News for hackers. Stuff that matters.
Re:Oban, the job processing framework from Elixir, has come ... by sorenone on Wednesday January 28, 2026 @02:32PM (#46800393)
The vast majority of tasks you use a job processing framework for are related to io bound side effects: sending emails, interacting with a database, making http calls, etc. Those are hardly impacted by the fact that it's a single thread. It works really well embedded in a small service.

You can also easily spawn as many processes running the cli as you like to get multi-core parallelism. It's just a smidge* little more overhead than the process pool backend in Pro.

Also, not an expert on Celery.

Re:Oban, the job processing framework from Elixir, has come ... by dec0dedab0de on Wednesday January 28, 2026 @04:01PM (#46801444)
I use celery when I need to launch thousands of similar jobs in a batch across any number of available machines, each running multiple processes with multiple threads.

I also use celery when I have a process a user kicked off by clicking a button and they're watching the progress bar in the gui. One process might have 50 tasks, or one really long task.