Re:Show HN: uDSV.js – A faster CSV parser in 5KB (min)
by texodus on Wednesday September 06, 2023 @10:20PM
(#37413956)
The CSV parser for [Perspective](https://github.com/finos/perspective) uses the [Apache Arrow](https://github.com/apache/arrow) C++ CSV parser compiled to WASM. It's not currently multi-threaded but this is possible as well to my understanding.
Re:Show HN: uDSV.js – A faster CSV parser in 5KB (min)
by leeoniya on Wednesday September 06, 2023 @10:24PM
(#37413987)
what i learned from benchmarking Dekkai, is that simply "being in WASM" is a poor indicator of actual performance if you ever need to pull the values across that boundary into JS...especially strings.
i'll take a look and see if i can incorporate Perspective's parser into the bench, thanks!
at some point it makes sense to simply recommend using WASM SQLite (or DuckDB) to load the data for OLAP stuff. im not gonna encourage anyone to use JS on multi-GB files. even a few hundred MB becomes questionable ;)