News for hackers. Stuff that matters.
Re:Heroku Kafka by saryant on Tuesday April 26, 2016 @10:17PM (#11577397)
Kafka, Redis and Logstash+ElasticSearch have really nothing to do with each other.

Kafka is a distributed, fault-tolerant and highly scalable message broker.

Redis is a very fast key/value (another other data types) store.

I suppose that at a high level Logstash can be compared to Kafka but IME Logstash can't handle scale. It's trivially easy to bring Logstash to its knees.

Elasticsearch is, well, a search engine.

Re:Heroku Kafka by 010a on Tuesday April 26, 2016 @10:51PM (#11577537)
Redis does a lot more than just store keys and values. Functionally speaking Redis Pub/Sub and Kafka are interchangable up to a certain level of throughput.
Re:Heroku Kafka by saryant on Tuesday April 26, 2016 @10:59PM (#11577565)
They really serve very different use cases. Redis pub/sub consumers only receive messages while connected, whereas Kafka consumers can pick up where they left off. Event ordering, back pressure, etc.

There are many use cases Redis pub/sub can't serve beyond just scalability.