Re:Test for lists in Cython
by andi999 on Monday April 19, 2021 @07:30AM
(#26861505)
Why not use the multiprocessing module? (if you can partition your problem space). I find memory sharing much more difficult to reliably implement an algorithm, and speed gain might be lower through cache conflicts.
[ Parent
| on HN ]
> cache conflicts
This can be an absolute sinkhole for performance, but if you have a large dataset you shouldn't be sharing lines that much one would hope.
Then you shd be able to do process parallelization.
A real hard requirement is going to be resource pools such as session linked connection pools with associated data. But there are just plenty of places where you don't want to be forced into a message passing architecture for a service and shared memory may be a better fit.