News for hackers. Stuff that matters.
Re:Show HN: Pipelines – Language for scripting parrallel pip... by nicois on Saturday January 19, 2019 @06:17PM (#18949840)
I'm not sure I understand the wins of this over just using the standard multiprocessing module.

You can trivially define a worker pool or arbitrary size and pipe a stream of values through your function using multiple cores, avoiding GIL issues.

If you have something which scales to multiple machines just use celery or redis streams.

Re:Show HN: Pipelines – Language for scripting parrallel pip... by mistrial9 on Saturday January 19, 2019 @07:38PM (#18950201)
DASK