News for hackers. Stuff that matters.
Re:Secor: A service persisting Kafka logs to S3, GCS and Azu... by rad_gruchalski on Friday March 27, 2020 @03:23PM (#22705949)
Maybe Pulsar gets close. Your general question regarding Kafka reminds me of this: https://medium.com/@rad_g/the-case-for-kafka-cold-storage-32...

I’ve written that.

Edit: kafka jira did not get far: https://issues.apache.org/jira/plugins/servlet/mobile#issue/...

Re:Secor: A service persisting Kafka logs to S3, GCS and Azu... by PhoenixReborn on Friday March 27, 2020 @04:06PM (#22706309)
Confluent actually has released "tiered storage" which appears to be a similar feature to what Pulsar has. https://www.confluent.io/blog/infinite-kafka-storage-in-conf...

It's still up in the air as to whether this feature will make its way into the open-source Kafka though.