Depends entirely on your setup but this work seems a good fit for a job queue where you can spread the work over multiple machines and processes.

I believe celery has integrations for Django.