Re:How to use a Python multiprocessing module
by velosol on Saturday July 29, 2023 @09:50AM
(#36920309)
I like "emergency brake" as a variable name!
Glad to help, it was similar for me with a lot of effort to synthesize best practices and really appreciate all the concurrent options (asyncio, threads, MP) for where they each are valuable.
BTW, I haven't touched MP in Py for couple of years now, but remember there's some misalignment in concurrent futures between pool.map and pool.submit.
And for exceptions in background processes, I had a shared bool var called "emergency brake", and an error queue.