News for hackers. Stuff that matters.
Re:Test for lists in Cython by ekianjo on Monday April 19, 2021 @07:31AM (#26861520)
> Python for the last few years is that you cannot take advantage of multiple cores of a CPU easily.

Same thing in the R ecosystem, it's possible to use multiple cores with the parallel package but there are caveats too.

Re:Test for lists in Cython by clircle on Monday April 19, 2021 @09:49AM (#26862722)
I do as much data work as possible in data.table, which parallelizes things under the hood, and doesn't seem to require me to configure anything.
Re:Test for lists in Cython by curiousgal on Monday April 19, 2021 @07:41AM (#26861607)
I haven't run into any issues with that package honestly (mclapply ftw!). Other than not being able to use it on Windows of course.
Re:Test for lists in Cython by gbrown on Monday April 19, 2021 @08:17AM (#26861894)
It’s process based, so communication overhead is heavy and the infrastructure is minimal - if you’re distributing jobs which are individually large it works fine, but it can’t really be used to replace multithreading in a shared memory model.