News for hackers. Stuff that matters.
Re:How to use a Python multiprocessing module by culebron21 on Friday July 28, 2023 @03:59PM (#36912479)
Thanks. That's more or less how I solved these problems too. And the questions are what I had to painstakingly answer myself at work.

BTW, I haven't touched MP in Py for couple of years now, but remember there's some misalignment in concurrent futures between pool.map and pool.submit.

And for exceptions in background processes, I had a shared bool var called "emergency brake", and an error queue.

Re:How to use a Python multiprocessing module by velosol on Saturday July 29, 2023 @09:50AM (#36920309)
I like "emergency brake" as a variable name!

Glad to help, it was similar for me with a lot of effort to synthesize best practices and really appreciate all the concurrent options (asyncio, threads, MP) for where they each are valuable.