Re:Why isn't differential dataflow more popular?
by jfim on Friday January 22, 2021 @02:21AM
(#25869310)
> there's no reason Kafka's starting experience couldn't be the same if someone cared enough to put the time and effort in
There's always a perverse incentive when the software provider's model is to monetize through support, consulting, and offering the software as a managed service. If it's too easy to run, then why would one pay for any of these services?
Re:Why isn't differential dataflow more popular?
by trumpeta on Friday January 22, 2021 @06:31AM
(#25870711)
Do you have an opinion on MSK?
Re:Why isn't differential dataflow more popular?
by lmm on Friday January 22, 2021 @09:45PM
(#25879066)
AIUI it's pretty expensive compared to, say, RDS or their managed Redis service? Which makes perfect sense relative to how much of a pain running your own Kafka cluster is.
100% worth it IMO, but it's a lot of upfront cost and you only start to see the benefits when a given flow is Kafka end-to-end and you learn how to use it, so I absolutely get why people are skeptical.
I say this as a huge fan of Kafka, but things like MySQL have better defaults and are easier to get running out of the box, and there's no reason Kafka's starting experience couldn't be the same if someone cared enough to put the time and effort in. And ultimately it's a shame, because it leads people to ignore something that's a much better model and platform in the long term.