Re:Go Python, Go: Stream Processing for Python
by jimktrains2 on Thursday October 12, 2017 @06:40PM
(#15461897)
I used Google Cloud Dataflow at a previous job. I really did like it and feel like Beam is set up pretty well. Thanks!
You can take a look at and run the streaming wordcount example in Beam: https://github.com/apache/beam/blob/master/sdks/python/apach...
In addition to the available local execution, Google also offers running Beam pipelines as a managed service in Cloud Dataflow (https://cloud.google.com/dataflow/). Python streaming is in private alpha--contact us at [email protected] if you'd like to try it out.
Note: I work for Google on Apache Beam and Cloud Dataflow.