Re:Publishing with Apache Kafka at The New York Times
by cookiecaper on Thursday September 07, 2017 @02:33PM
(#15194558)
>Kafka is not a messaging queue. It's a log.
Kafka bills itself as a "messaging system".
>The same underlying structure used within our RDBMS to provide all the guarantees Kafka provides.
Is there perhaps a reason that people use the RDBMS scaffold atop this "underlying structure"? The point I'm making is that Kafka is not safe for use cases that demand robust data storage and integrity, at least not in comparison to the standard of safety set by the traditional systems of record for important data (RDBMS).
Re:Publishing with Apache Kafka at The New York Times
by miguno on Thursday September 14, 2017 @10:55AM
(#15248617)
Small and friendly correction: Kafka bills itself as "a distributed streaming platform".
Also, a heads up: we'll soon publish a blog post on the subject of "is it ok to (permanently) store data in Apache Kafka".
The same underlying structure used within our RDBMS to provide all the guarantees Kafka provides.
As for logs and databases, they are duals.
https://www.confluent.io/blog/turning-the-database-inside-ou...