Re:Go Python, Go: Stream Processing for Python
by buriama8 on Thursday October 12, 2017 @09:05AM
(#15457635)
Could anyone recommend any resources comparing the various stream processing frameworks? Apache Storm (which I am familiar with), the below mentioned Apache Beam (of which I just heard for the first time), this new Wallaroo and any others? Beside their homepages, that is.
[ Parent
| on HN ]
Re:Go Python, Go: Stream Processing for Python
by spooneybarger on Thursday October 12, 2017 @09:11AM
(#15457668)
Stepping outside of my "Wallaroo Labs employee" role for a moment.
Comparisions can be really hard. What's right for one application or project isn't right for another. I'd be happy to chat over email with anyone interested in stream processing about the types of applications they are looking to build, the requirements they have etc.
I get nice use cases and information we can use at Wallaroo Labs to help drive our product. In return, I will give unbiased feedback on what you should be looking for to solve a given problem.
My personal email is in my HN profile.
Disclosure:
In case it isn't obvious, I work at Wallaroo Labs, the makers of Wallaroo. I'm also one of the authors of Storm Applied, Manning's book on Apache Storm.
Re:Go Python, Go: Stream Processing for Python
by fnl on Thursday October 12, 2017 @03:35PM
(#15460657)
I'd be interested in understanding which design is closest to yours, however. Flink? Akka Streams? Another?
Re:Go Python, Go: Stream Processing for Python
by spooneybarger on Thursday October 12, 2017 @04:15PM
(#15460954)
That's complicated and nuanced. I'd be happy to have that conversation over email.
Re:Go Python, Go: Stream Processing for Python
by kitd on Thursday October 12, 2017 @03:52PM
(#15460799)
Here's one for just the Apache frameworks:
https://databaseline.bitbucket.io/an-overview-of-apache-stre...
Not sure how Wallaroo compares though.