Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Ask HN: How would you queue and process 10K+ long running jobs.
Python based:
http://www.celeryproject.org/ <-- async task queue
https://github.com/spotify/luigi <-- more pipe line centric
There are many like it. RQ(more bare bone)
There are no comments on this comment yet.
Python based:
http://www.celeryproject.org/ <-- async task queue
https://github.com/spotify/luigi <-- more pipe line centric
There are many like it. RQ(more bare bone)