News for hackers. Stuff that matters.

A comment on Scalable Stream Processing: A Survey of Storm, Samza, Spark and Flink. Parent comment

Re:Scalable Stream Processing: A Survey of Storm, Samza, Spa... by gfodor on Sunday September 18, 2016 @06:29PM (#12527543)
It still requires Java and Kafka, but Kafka Streams is a library that lets you build stream processing jobs without a centralized cluster if you have Kafka running. Just embed the jar and run your class on as many machines as you like and they will self-organize and balance. Worth checking out.
[ Parent | on HN ]
Re:Scalable Stream Processing: A Survey of Storm, Samza, Spa... by justinsaccount on Sunday September 18, 2016 @06:45PM (#12527589)
yeah.. The kafka streams library does look nice, especially how they don't care how you run the thing.

It's a bit harder to dive into java though.

The thing I have a use case for stream processing is basically glorified wordcount - just over a realtime 7 day window. The data processing code is the easy part, the tooling/runtime is the hard part.

[ Parent | on HN ]
Re:Scalable Stream Processing: A Survey of Storm, Samza, Spa... by cel1ne on Monday September 19, 2016 @02:54AM (#12529490)
Regarding java tooling: check out the blog posts "not your father's java" and especially the part about capsule packaging.
[ Parent | on HN ]