News for hackers. Stuff that matters.
Re:Heroku Kafka by ec109685 on Wednesday April 27, 2016 @01:36AM (#11578038)
ElasticSearch can store sequenced number data, which is really all that Kafka is doing, so I don't think it is fair to say it isn't related at all.
Re:Heroku Kafka by allengeorge on Wednesday April 27, 2016 @07:42AM (#11579479)
So can a RDBMS... But that doesn't mean that Kafka and databases are related.

As multiple comments have stated above, Kafka is really a distributed message subsystem. Its core interface is a set of topics that one can publish to, and that consumers can read from (in other words, a pub-sub system). Kafka doesn't inspect the message payload at all.

Elasticsearch is a unstructured (to some extent) document store that's optimized around document search. So at the very least, the payload is important when using Elasticsearch.

Re:Heroku Kafka by manigandham on Wednesday April 27, 2016 @09:51PM (#11586087)
That's like saying they all write data to disk so they're related.

Elasticsearch is all about saving, inspecting, indexing and retrieving your data through a rich document-based model and search-optimized methods.

ES might be able to do the same thing functionally because it operates at a higher level but ultimately will never scale or be as simple in access as Kafka.