Re:A gentle-ish introduction to worst-case optimal joins
by sitkack on Thursday June 02, 2022 @10:16PM
(#31603449)
Most systems that make expensive scans should be updating or creating a count-min-sketch histogram of the data to allow schedulers and query planners to do a better job.
https://en.wikipedia.org/wiki/Count%E2%80%93min_sketch
https://duckduckgo.com/?t=ffab&q=count-min+sketch+site%3Avld...
https://www.semanticscholar.org/search?q=count-min%20sketch%...
Spark will re-run the query planner after doing the map stage of a map-reduce operation so as to leverage the information collected: https://databricks.com/blog/2020/05/29/adaptive-query-execut...
Both examples represent changing parameters about a lower level plan than simply join operators, but the industry is certainly moving in this direction.