News for hackers. Stuff that matters.
Re:Kafka Spawns Open-Source KarelDB by netfl0 on Tuesday October 01, 2019 @04:27PM (#21130221)
Can anyone explain why this might be exciting? (genuinely curious)
Re:Kafka Spawns Open-Source KarelDB by manigandham on Tuesday October 01, 2019 @10:25PM (#21132949)
It's exciting in the sense that you can apply all these open-source projects to create a very slick lightweight relational database that can replicate changes globally across unlimited instances by using a Kafka topic as the WAL log.

Don't actually use this in production. Use a real database that does what you want, and use the native replication features. If you need to replicate to heterogenous or alternative sources or just want a stream of all changes then you can use Kafka with any number of existing database connectors that automatically read and export changes.

Re:Kafka Spawns Open-Source KarelDB by thanatos_dem on Tuesday October 01, 2019 @04:37PM (#21130329)
Ever wanted a database with all the operational complexity of Kafka, and more? Well now you can have it!

It’s exciting as someone more in the SRE side, because you’d need to pay be an obscene amount to support this.

Re:Kafka Spawns Open-Source KarelDB by diehunde on Tuesday October 01, 2019 @10:03PM (#21132854)
Isn't that "side" just a bunch of clicks on a wizard on some cloud provider?
Re:Kafka Spawns Open-Source KarelDB by slowmovintarget on Tuesday October 01, 2019 @04:58PM (#21130561)
It's like the bulked-up Cartman of key-value stores.

Edit: Nope, it's a relational DB

Re:Kafka Spawns Open-Source KarelDB by solatic on Tuesday October 01, 2019 @05:10PM (#21130697)
There are companies that fit the following operational niche:

* Need to run Kafka (for domain-specific reasons)

* Need a relational database, but not necessarily a large or performant one

A project that lets you "buy a Kafka cluster, get the relational database free" is strictly simpler and cheaper to operate (in theory...) compared to operating both a Kafka cluster and a traditional relational database.

Re:Kafka Spawns Open-Source KarelDB by random023987 on Tuesday October 01, 2019 @06:29PM (#21131527)
If you want an asymmetric persistence layer where all writes are documents placed in a Kafka topic, and all reads are via relational queries.

It's a distributed, eventually consistent, highly available ledger that can be queried with SQL.

Re:Kafka Spawns Open-Source KarelDB by Scarbutt on Tuesday October 01, 2019 @06:53PM (#21131752)
Is not eventually consistent, it uses https://omid.incubator.apache.org/.
Re:Kafka Spawns Open-Source KarelDB by adamnemecek on Tuesday October 01, 2019 @05:15PM (#21130743)
It uses kafka as an operational primitive. Kafka is somewhat complicated but it also solves real problems. I can see a fast, distributed db built on top of kafka.
Re:Kafka Spawns Open-Source KarelDB by qaq on Tuesday October 01, 2019 @07:25PM (#21131984)
There fast distributed DBs and they are generally built on top of distributed ordered key-value stores. Many of them do not require to run external components like zookeeper. What is the advantage of running one on top of Kafka?
Re:Kafka Spawns Open-Source KarelDB by Godel_unicode on Tuesday October 01, 2019 @08:24PM (#21132329)
The main benefit I have heard is that some people already have Kafka.
Re:Kafka Spawns Open-Source KarelDB by qaq on Tuesday October 01, 2019 @08:48PM (#21132466)
in what sense is it a benefit?