News for hackers. Stuff that matters.

A comment on Tiered storage won't fix Kafka. Parent comment

Re:Tiered storage won't fix Kafka by solatic on Monday April 29, 2024 @12:11PM (#40200210)
> so it gets rid of all the operational and scaling problems you have with a typical tiered storage Kafka setup

Do these operational and scaling problems include AWS's managed services? MSK, Kinesis Data Streams?

At small scale, why wouldn't someone go with one of those? And at large scale, where's the Total Cost of Ownership comparison to show that it's worth it to ditch Kafka's local disks for a model built on object storage?

[ Parent | on HN ]
Re:Tiered storage won't fix Kafka by richieartoul on Monday April 29, 2024 @12:19PM (#40200347)
Short answer is that MSK has (almost) all the same problems as OSS Kafka. Kinesis streams is a different beast that would require its own blog post.

RE:numbers: https://www.warpstream.com/blog/warpstream-benchmarks-and-tc...

[ Parent | on HN ]