News for hackers. Stuff that matters.

codelipenghui

Just share a blog post published before, which compares the costs of running a 5 GB/s Kafka workload using Ursa, Warpstream, MSK, and Redpanda:

https://streamnative.io/blog/how-we-run-a-5-gb-s-kafka-workl...

And the test result was verified by Databricks: https://www.linkedin.com/posts/kramasamy_incredible-streamna...

The analysis in the blog is based on two key assumptions:

- Multi-zone deployment on AWS - Tiered storage is not enabled

If you’re looking to estimate costs with tiered storage, you can ignore the differences in storage costs mentioned in the post.

One important point not covered in the blog is that Ursa compacts data directly into a Lakehouse (This is also the major differentiator from WarpStream). This means you maintain only a single copy of data, shared between both streaming reads and table queries. This significantly reduces costs related to:

- Managing and maintaining connectors - Duplicated data across streaming and Lakehouse systems