News for hackers. Stuff that matters.

A comment on Redpanda – A Kafka-compatible streaming platform for mission-critical workloads. Parent comment

Re:Redpanda – A Kafka-compatible streaming platform for miss... by agallego on Thursday November 12, 2020 @05:31PM (#25076088)
We had success with very large customers (enterprise) and also some success with finance company (looking for 0 data loss). The idea is that we can give the kafka API compat system with 10x lower tail latencies for free and still monetize the high end of the market.

I think there is a big shift when you have a single binary. i.e.: no one really complains from running ngix, etc because it's easy to get up and running.

so the gist we wanted to let everyone use it and reserve the right to be the only hosted redpanda provider.

[ Parent | on HN ]
Re:Redpanda – A Kafka-compatible streaming platform for miss... by gtirloni on Monday November 16, 2020 @07:56AM (#25111043)
> so the gist we wanted to let everyone use it and reserve the right to be the only hosted redpanda provider.

It seems totally fair to me. Good luck with this approach. I think yours odds are good.

[ Parent | on HN ]
Re:Redpanda – A Kafka-compatible streaming platform for miss... by agallego on Thursday November 12, 2020 @05:33PM (#25076122)
also i'd note one more thing which is the WASM API is going to give us an opportunity to add more enterprise value.

i.e.: think GDPR compliance as long as your data streams are in JSON or some predefined format.

WASM basically allows us to push computational guarantees to the storage engine itself without a separate cluster.

[ Parent | on HN ]
Re:Redpanda – A Kafka-compatible streaming platform for miss... by porker on Monday November 16, 2020 @10:44AM (#25113046)
Is there a blog post or docs showing using WASM? I searched your site but couldn't find details.

I've failed to grasp if it's an "alternative plugin-engine" kind of system to extend Redpanda, or you're storing data as WASM and therefore it's executable (to take your example: GDPR compliant auto-expire if it's past a certain date).

[ Parent | on HN ]
Re:Redpanda – A Kafka-compatible streaming platform for miss... by cookiesboxcar on Monday November 16, 2020 @09:01AM (#25111692)
what does WASM mean in this context?
[ Parent | on HN ]
Re:Redpanda – A Kafka-compatible streaming platform for miss... by sorenbs on Monday November 16, 2020 @09:06AM (#25111742)
https://webassembly.org/
[ Parent | on HN ]
Re:Redpanda – A Kafka-compatible streaming platform for miss... by cookiesboxcar on Monday November 16, 2020 @10:10AM (#25112572)
Thanks -- I had never considered using webassembly in this way, so I thought it was something different.
[ Parent | on HN ]