News for hackers. Stuff that matters.
Re:Materialized views are obviously useful by jamesblonde on Sunday August 24, 2025 @03:22PM (#45006897)
This triggered me in the article

'There are a few startups these days peddling a newfangled technology called “incremental view maintenance” or “differential dataflow”. '

Incremental view maintenance can change recomputation cost of view updates from O(N) to O(1). DBSP is based on z-sets, a generalization of relational algebra. The paper won best paper at SIGMOD. There is a startup, Feldera, commercializing it.

This is just ignorance to dismiss as 'new fangled'.

Re:Materialized views are obviously useful by PerryStyle on Sunday August 24, 2025 @03:33PM (#45006987)
+1. Learned about this in DB research course during grad school. Feldera is really cool.

Also I love their website design.

Re:Materialized views are obviously useful by lsuresh on Sunday August 24, 2025 @05:58PM (#45008180)
Thanks for the kind words (Feldera co-founder here). I'll pass it on to the design team. :)
Re:Materialized views are obviously useful by anon84873628 on Sunday August 24, 2025 @04:08PM (#45007323)
I mean, everything you said sounds exactly like the definition of "new fangled" to me. I don't think the term is meant to be so pejorative or dismissive, just that the tech is currently intimidating to people not on the cutting edge. (Edit: e.g. taking graduate level database courses, as mentioned by a sibling comment :-)

There is constantly so much new stuff in software, you have to be a bit willfully ignorant of some things some of the time.

Re:Materialized views are obviously useful by jamesblonde on Sunday August 24, 2025 @04:35PM (#45007528)
Does going from O(N) to O(1) sound like "new fangled"? That is the smell of progress
Re:Materialized views are obviously useful by Zen1th on Sunday August 24, 2025 @04:50PM (#45007647)
You're taking "new fangled" too literally. Is it new, as in not everyone concerned is aware of it? Yes! I think the author is as enthusiastic about this as you are.
Re:Materialized views are obviously useful by jamesblonde on Monday August 25, 2025 @01:58PM (#45016741)
New fangled is unambiguously pejorative, both in the absolute sense and in how it is used in the article. If it looks like shit and smells like shit, don't tell me it's not shit.
Re:Materialized views are obviously useful by anon84873628 on Tuesday August 26, 2025 @11:30AM (#45027958)
Let's look at the text!

>There are a few startups these days peddling a newfangled technology called “incremental view maintenance” or “differential dataflow”. Basically the way it works is you just say “hey, I’d like to keep track of how many tasks each project has” by writing any SQL query you want:

>[query]

>The “magic” is actually really cool. Basically the SQL query is analyzed to produce a DAG of the data flow with different nodes for filters, groups, joins, etc, and then each node “knows” how to map any change in its input to the appropriate change in the output.

So the person who calls the technology "magic" (with emoji sparkles around it!) and "really cool" and generally spent all this time writing an article about this particular annoying problem and all of the other bad solutions about it, and then mention these startups at the end... Is being denigrating and dismissive.

Which one of these companies do you work for that causes you to feel so hurt? Because the author didn't mention them by name?

Re:Materialized views are obviously useful by jamesblonde on Tuesday August 26, 2025 @04:44PM (#45032080)
None of them. I have no skin in the game here.
Re:Materialized views are obviously useful by tylerhou on Tuesday August 26, 2025 @03:51AM (#45023528)
IVM is not new, but the DBSP (2022) perspective is relatively new for databases (where the classic literature is from the 70s and 80s).

It is misleading to say that IVM reduces the cost of view updates from O(n) to O(1). While that is not technically incorrect, for any nontrivial query (e.g anything with an index join) the cost of a view update will be smaller than the original query but not constant time.

Also, the tone of “newfangled” was not dismissive in the context of an article praising IVM. At worst, it was sarcastic; I interpreted it as teasing.

I do research related to IVM / DBSP.