Re:Kafka-on-Pulsar: bring native Kafka protocol support to A...
by adamfeldman on Tuesday March 24, 2020 @06:42PM
(#22679863)
Splunk bought a company called Streamlio [1].
StreamNative is the company behind the linked blog post and project.
My (outsider) understanding is that both Streamlio and Splunk employ(ed) active members of the Pulsar community.
[1]: https://www.splunk.com/en_us/blog/leadership/splunk-to-expan...
Re:Kafka-on-Pulsar: bring native Kafka protocol support to A...
by oweiler on Wednesday March 25, 2020 @12:34PM
(#22686167)
I always hear it's better architecture-wise but what are the real life implications of difference?
Also, Kafka has:
* ksql * ksqlDB * Kafka Connect * Kafka Streams
Does Pulsar has something comparable?
Re:Kafka-on-Pulsar: bring native Kafka protocol support to A...
by thenaturalist on Thursday March 26, 2020 @11:41AM
(#22694652)
Yes, you can run SQL using Presto [1], and by connecting.
Not sure about ksqlDB as I am not familiar with it, but my understanding is Apache Flink would give you analog capabilities. Pulsar has IO capabilities analog to Kafka Connect [2]. Analogous to Kafka Streams, Pulsar offers Functions [3].
[1] http://pulsar.apache.org/docs/en/sql-overview/
It looks to of stagnated since the announcement was made.
Architecture wise Pulsar is a far better piece of engineering than Kafka but with Confluent's funding and aggressive marketing it looks like Kafka has cornered the market for better or worse.