News for hackers. Stuff that matters.
Re:Kafka at the Low End by gnfargbl on Wednesday February 19, 2025 @04:42AM (#43100363)
Pulsar. Works extremely well as both a job queue and a data bus.

We have been using it in this application for half a decade now with no serious issues. I don't understand why it doesn't get more popular attention.

Re:Kafka at the Low End by akshayshah on Wednesday February 19, 2025 @10:40AM (#43103251)
Even StreamNative is effectively abandoning Pulsar and going all-in on the Kafka protocol. I can see the theoretical benefits of Pulsar, but it just doesn’t seem to have the ecosystem momentum to compete with the Kafka juggernaut.
Re:Kafka at the Low End by gnfargbl on Wednesday February 19, 2025 @10:46AM (#43103326)
The advantages of Pulsar are very much practical, at least for us. Without it we would have to manage two separate messaging systems.

I don't see any evidence of StreamNative abandoning Pulsar at this point. I do see a compatibility layer for the Kafka protocol. That's fine.

Re:Kafka at the Low End by akshayshah on Wednesday February 19, 2025 @11:54AM (#43104302)
It sure looks like they’re going quite a ways beyond Kafka-on-Pulsar - the Ursa/Oxia work they’re focused on right now replaces BookKeeper and seems very firmly Kafka-oriented. Or does Ursa also work with the Pulsar protocol?
Re:Kafka at the Low End by matteomerli on Sunday February 23, 2025 @12:02PM (#43150899)
Ursa supports Pulsar protocol as well
Re:Kafka at the Low End by VenturingVole on Wednesday February 19, 2025 @06:21PM (#43109055)
Pulsar vs Kafka was a significant lesson to me: The "best" technology isn't always the winner.

I put it in quotes because I'm a massive fan of Pulsar and addressing the shortcomings of Kafka. However, with regards to some choices at a former workplace: The broader existing support/integration ecosystem along with Confluent's commercial capabilities won out with regards to technology choices and I was forced to acquiesce.

A bit like Betamax vs VHS, albeit that one pre-dates me significantly.

Re:Kafka at the Low End by enether on Sunday February 23, 2025 @04:52PM (#43153566)
and it then becomes a self-perpetuating cycle because the network effect and usage of one product makes it become exponentially more robust & mature than the other. I've heard that Pulsar is buggy basically, and I wouldn't be surprised because it doesn't have thousands of organizations using it in all sorts of ways. It's not its fault too much really