Re:How PlanetScale Boost serves your SQL queries instantly
by brancz on Tuesday November 15, 2022 @04:06PM
(#33615007)
I don’t really know either very well, but how does Noria compare to Naiad? Are they comparable at all?
I already had Naiad on my reading list, definitely adding Noria as well! Thank you very much for your work!
Re:How PlanetScale Boost serves your SQL queries instantly
by exabrial on Tuesday November 15, 2022 @05:22PM
(#33615938)
for readyset: Is there a deb package available or something lighter weight than docker, kubernets, etc? I'd just like to run it as a regular unix process and start/stop it with systemd.
Re:How PlanetScale Boost serves your SQL queries instantly
by greg-m on Tuesday November 15, 2022 @05:26PM
(#33616001)
yes! shoot me an email - [email protected] - we're in the process of building binaries for more platforms, lmk which you need.
Re:How PlanetScale Boost serves your SQL queries instantly
by exabrial on Tuesday November 15, 2022 @05:55PM
(#33616364)
I mean just the standard x86/ubuntu 22.04 would be nice. It'd reduce a lot of friction to people try to evaluate your product!
Re:How PlanetScale Boost serves your SQL queries instantly
by marzoevam on Tuesday November 15, 2022 @09:08PM
(#33617934)
Here's a link to our binaries! https://docs.readyset.io/releases/readyset-core/
Re:How PlanetScale Boost serves your SQL queries instantly
by exabrial on Wednesday November 16, 2022 @10:55AM
(#33625198)
Thanks! We're going to give this a whirl
Re:How PlanetScale Boost serves your SQL queries instantly
by vlovich123 on Tuesday November 15, 2022 @09:14PM
(#33617979)
Hi Greg. Fancy seeing you here :)
I'm so excited to see dynamic, partially-stateful data-flow for incremental materialized view maintenance becoming more wide-spread! I continue to think it's a _great_ idea, and the speed-ups (and complexity reduction) it can yield are pretty immense, so seeing more folks building on the idea makes me very happy.
The PlanetScale blog post references my original "Noria" OSDI paper (https://pdos.csail.mit.edu/papers/noria:osdi18.pdf), but I'd actually recommend my PhD thesis instead (https://jon.thesquareplanet.com/papers/phd-thesis.pdf), as it goes much deeper about some of the technical challenges and solutions involved. It also has a chapter (Appendix A) that covers how it all works by analogy, which the less-technical among the audience may appreciate :) A recording of my thesis defense on this, which may be more digestible than the thesis itself, is also online at https://www.youtube.com/watch?v=GctxvSPIfr8, as well as a shorter talk from a few years earlier at https://www.youtube.com/watch?v=s19G6n0UjsM. And the Noria research prototype (written in Rust) is on GitHub: https://github.com/mit-pdos/noria.
As others have already mentioned in the comments, I co-founded ReadySet (https://readyset.io/) shortly after graduating specifically to build off of Noria, and they're doing amazing work to provide these kinds of speed-ups for general-purpose relational databases. If you're using one of those, it's worth giving ReadySet a look to get these kinds of speedups there! It's also source-available @ https://github.com/readysettech/readyset if you're curious.