DuckDB-Wasm: Efficient analytical SQL in the browser

Re:DuckDB-Wasm: Efficient analytical SQL in the browser by timwis on Friday October 29, 2021 @12:45PM (#29040667)

Interesting.. Would this be effective at loading a remote CSV file with a million rows, then performing basic GROUP BY COUNTs on it so I can render bar charts?

I’ve been thinking of using absurd-sql for it since I saw https://news.ycombinator.com/item?id=28156831 last week

[ Parent | on HN ]

Re:DuckDB-Wasm: Efficient analytical SQL in the browser by texodus on Friday October 29, 2021 @01:10PM (#29040964)

I contribute to https://perspective.finos.org/ , supports all of this and quite a lot more.

Here's 1,000,000 rows example I just threw together for you

https://bl.ocks.org/texodus/3802a8671fa77399c7842fd0deffe925

and a CSV example, you try yours right now

https://bl.ocks.org/texodus/02d8fd10aef21b19d6165cf92e43e668

[ Parent | on HN ]

Re:DuckDB-Wasm: Efficient analytical SQL in the browser by ankoh on Friday October 29, 2021 @12:51PM (#29040750)

It depends.

Querying CSV files is particularly painful over the network since we still have to read everything for a full scan.

With Parquet, you would at least only have to read the columns of group by keys and aggregate arguments.

Try it out and share your experiences with us!

[ Parent | on HN ]