News for hackers. Stuff that matters.
Re:Pypeline: A Python library for creating concurrent data p... by TBastiani on Monday September 24, 2018 @08:11AM (#18056988)
mpipe might also be of interest.

http://vmlaker.github.io/mpipe/

Re:Pypeline: A Python library for creating concurrent data p... by cgarciae on Monday September 24, 2018 @01:33PM (#18059599)
Thanks! Did take a look at mpipe (its actually referenced in the readme). But mpipe has its flaws:

1. It uses None as the stage terminator, this is VERY error prone, what if you actually want to send None? Pypeline uses a special private terminator.

2. You have to first manually put all the data into the pipe in a for-loop and then manually get it out. In Pypeline all this is simplified: it consumes iterables and all stages are iterables, so its 100% compatible with any function/framework that accepts iterables.

Re:Pypeline: A Python library for creating concurrent data p... by cgarciae on Monday September 24, 2018 @01:36PM (#18059620)
3. If you first have to put in all the data first you cant handle streams. Pypeline accepts non-terminating iterables and also gives you back possibly non-terminating iterables.