Re:DuckDB-Wasm: Efficient analytical SQL in the browser
by obeliskora on Friday October 29, 2021 @11:59AM
(#29040072)
There was neat post https://news.ycombinator.com/item?id=27016630 a while ago about about using sqlite on static pages with large datasets that wouldn't have to be loaded entirely. Does duckdb do something similar with arrow/parquet files or its own format?
[ Parent
| on HN ]
Re:DuckDB-Wasm: Efficient analytical SQL in the browser
by ankoh on Friday October 29, 2021 @12:04PM
(#29040120)
Yes we do! DuckDB-Wasm can read files using HTTP range requests very similar to the sql.js-httpvfs from phiresky.
The blog post contains a few examples how this can be used, for example, to partially query Parquet files over the network.
E.g. just visit shell.duckdb.org and enter:
select * from 'https://shell.duckdb.org/data/tpch/0_01/parquet/orders.parqu...' limit 10;
Re:DuckDB-Wasm: Efficient analytical SQL in the browser
by 1egg0myegg0 on Friday October 29, 2021 @12:07PM
(#29040164)
NIIIICE!
Data twitter was pretty excited about that cool SQLite trick - now you can turn it up a notch!
Re:DuckDB-Wasm: Efficient analytical SQL in the browser
by tomrod on Friday October 29, 2021 @02:31PM
(#29041974)
Is data twitter == #datatwitter, like Econ Twitter is #econtwitter?
If so, I have another cool community to follow!
Re:DuckDB-Wasm: Efficient analytical SQL in the browser
by obeliskora on Friday October 29, 2021 @01:32PM
(#29041249)
It would be really cool to load duckdb files too. sql.js-httpvfs seems convenient because it works on everything in database so you don't have to create indexes, or setup keys and constraints in the client.
Re:DuckDB-Wasm: Efficient analytical SQL in the browser
by ankoh on Friday October 29, 2021 @02:45PM
(#29042147)
I agree! DuckDB-Wasm can already open DuckDB database files in the browser the very same way.
Re:DuckDB-Wasm: Efficient analytical SQL in the browser
by obeliskora on Friday October 29, 2021 @12:19PM
(#29040318)
That's really neat! Can you control the cache too?