Re:Show HN: Spice.ai – materialize, accelerate, and query SQ...
by prabhatsharma on Thursday March 28, 2024 @08:06PM
(#39859031)
Do you support subqueries and joins?
[ Parent
| on HN ]
Re:Show HN: Spice.ai – materialize, accelerate, and query SQ...
by lukekim on Thursday March 28, 2024 @09:05PM
(#39859452)
Spice supports what DataFusion supports, which is generally yes but there is still work to do to push down more queries to TableProviders. For example, joins within a single source are not yet pushed down to the underlying provider.
You can write a single query across many data sources which is what we show in the demo on the Git repo.
Re:Show HN: Spice.ai – materialize, accelerate, and query SQ...
by phillip-spice on Thursday March 28, 2024 @09:29PM
(#39859584)
There is an effort within DataFusion to support pushing down joins across tables from the same remote provider that we will likely contribute to as well: https://github.com/datafusion-contrib/datafusion-federation