Re:Dynamically changing, partially-stateful data-flow databa...
by agbell on Tuesday February 11, 2020 @09:50PM
(#22305285)
Noria looks very cool. A lot of engineering time is spent building by hand with kafka and microservices what Noria can seemly generate from a declarative create view statement.
He also has some rust great live coding stuff on youtube.
Re:Dynamically changing, partially-stateful data-flow databa...
by thom on Tuesday February 11, 2020 @07:34PM
(#22304554)
Claims to outperform Differential Dataflow[0] which underlies Materialize's[1] incremental materialized view product. Supports SQL out of the box. Definitely worth a deeper look. This is such an exciting area right now, I am envious of anybody writing streaming applications in five years time!
Re:Dynamically changing, partially-stateful data-flow databa...
by fsajkdnjk on Tuesday February 11, 2020 @08:09PM
(#22304752)
"Essentially a database that updates continuously materialized views upon write"
I do that now in my event-sourced application with stupid simple mysql. It is trivial to implement such functionality into the app layer and not into the storage where you are limited by the third party sw itself.
0: https://github.com/frankmcsherry/differential-dataflow
1: https://materialize.io/
* Essentially a database that updates continuously materialized views upon write
* For read heavy web applications
* Speaks MySQL Protocol (caveats apply)
I do that now in my event-sourced application with stupid simple mysql. It is trivial to implement such functionality into the app layer and not into the storage where you are limited by the third party sw itself.
Oh yes and it's in Rust, which is sexy.