Re:Data flow syntax: The missing piece for the success of fu...
by stuartaxelowen on Thursday July 16, 2015 @11:10PM
(#9901118)
If you're interested in this kind of stuff in python, you should check out datastreams: https://github.com/StuartAxelOwen/datastreams
[ Parent
| on HN ]
Re:Data flow syntax: The missing piece for the success of fu...
by msellout on Thursday July 16, 2015 @11:56PM
(#9901220)
Why is `datastreams` better than using generators and comprehensions, plus the itertools module in the standard library?
Re:Data flow syntax: The missing piece for the success of fu...
by stuartaxelowen on Friday July 17, 2015 @01:22AM
(#9901373)
It makes working with iterators easy - this way you're always talking about one thing at a time, instead of the whole collection/iterator, making efficient computation easy.
Also, the abstraction allows for optimizations like delegating to Apache Spark or other processes/threads.