Re:Apache Kafka 0.9 is released
by erichmond on Tuesday November 24, 2015 @12:08PM
(#10621997)
I'm always fascinated by the lack of discussion around distributed systems tooling on HN. Anyway! Congrats!
[ Parent
| on HN ]
The only other beast of similar nature that appears occasionally I can think of, is Onyx. Which seems pretty cool.
Anyway,Kafka Connect will provide what probably most people are looking for in Samza.
Re:Apache Kafka 0.9 is released
by nehanarkhede on Tuesday November 24, 2015 @12:26PM
(#10622130)
That observation is correct. Currently, people misuse stream processing systems like Storm and Samza for data import/export. This is an overkill. Kafka Connect is focused on providing scalable and operational connectors to various systems using Kafka as the underlying transport mechanism.
<plug>
We have built a fairly robust system along the idea of Kafka Connect and it's open sourced at https://github.com/flipkart/aesop. Currently, it supports MySQL & Hbase as sources and MySQL, Hbase, ES, Kafka as destination.