News for hackers. Stuff that matters.
Re:Show HN: Goka – distributed stream processing library for... by agnivade on Friday May 19, 2017 @06:38AM (#14374318)
How does this compare with https://github.com/movio/kasper ?
Re:Show HN: Goka – distributed stream processing library for... by 0xdb7 on Friday May 19, 2017 @09:44AM (#14375522)
There are several differences. Here are some of them.

- Kasper is micro-batched, Goka consumes one message at a time.

- Kasper requires a centralized state storage (such as Redis or ElasticSearch), Goka only depends on Kafka: processors persist their state (key-value tables) in a compacted topic in Kafka. That is really nice because processors can then join streams with tables of other processors.

- Kasper statically assigns partitions to processors. Goka automatically splits the input and state partitions among processors.

- By default Goka employs sarama and sarama-cluster libraries to access Kafka, but that can be easily replaced with Confluent's go library. Similarly, the local storage is by default LevelDB, but can be replaced even with some remote storage if necessary.