Let's Remove the Global Interpreter Lock

Re:Let's Remove the Global Interpreter Lock by bobwaycott on Monday August 14, 2017 @11:57AM (#15009602)

If you’re looking for simple threaded multiprocessing, it’s not that hard/painful:

    from multiprocessing.dummy import Pool
    
    pool = Pool(num_threads)
    result = pool.map(your_func, your_objects)
    pool.close()
    pool.join()

Improve and/or complicate things from there.

[ Parent | on HN ]

Re:Let's Remove the Global Interpreter Lock by zeptomu on Monday August 14, 2017 @03:45PM (#15012124)

This is a nice pattern and there are surprisingly many problems that can be solved that way. AFAIK you do not have to join() here as the processes die after the map call.

Often the challenge is a big amount of (hopefully read-only) data that you want to access in every 'your_func'. The naive solution is to copy the data, but this might blow your memory.

[ Parent | on HN ]