Re:An opinionated map of incremental and streaming systems
by sam0x17 on Tuesday May 04, 2021 @03:34PM
(#27041901)
Side note: one thing I've really noticed lacks formalism in a lot of programming languages and environments is easily streaming data and performing operations on a data "pipe". I normally dislike javascript, but Node.js actually does a pretty cool job of it with their streams API. Really wish every language had something like that built in, with flow control, etc., so you could e.g. pipe data through compression => encryption => measure size => upload and those sorts of flows. Even more useful is when all of these steps can run somewhat in parallel e.g. while datum 1 is being encrypted, datum 2 is being compressed, etc.
[ Parent
| on HN ]
Re:An opinionated map of incremental and streaming systems
by ramchip on Tuesday May 04, 2021 @06:45PM
(#27043801)
Elixir has a few interesting abstractions for that: GenStage, Flow, Broadway.
Re:An opinionated map of incremental and streaming systems
by superdimwit on Tuesday May 04, 2021 @05:43PM
(#27043269)
Go Channels?