News for hackers. Stuff that matters.
Re:Apache Arrow 3.0 by liminal on Wednesday February 03, 2021 @05:10PM (#26019821)
Would really love to see first class support for Javascript/Typescript for data visualization purposes. The columnar format would naturally lend itself to an Entity-Component style architecture with TypedArrays.
Re:Apache Arrow 3.0 by nevi-me on Wednesday February 03, 2021 @05:24PM (#26019977)
Have you seen https://github.com/finos/perspective? Though they removed the JS library a few months ago in favour of a WASM build of the C++ library.
Re:Apache Arrow 3.0 by juntan on Thursday February 04, 2021 @11:55AM (#26027170)
The JS library hasn't been removed - it's the main UI and API over the WASM library that allows for Perspective to be used in the browser: https://perspective.finos.org/
Re:Apache Arrow 3.0 by infinite8s on Thursday February 04, 2021 @08:49PM (#26032132)
I think the GP meant the Typescript arrow library.
Re:Apache Arrow 3.0 by infinite8s on Thursday February 04, 2021 @09:10PM (#26032263)
There is a Typescript arrow library that can operate off the IPC format. As an example use case, take a look at the arquero data processing library from the University of Washington (from the same group that created D3). https://github.com/uwdata/arquero
Re:Apache Arrow 3.0 by BadInformatics on Wednesday February 03, 2021 @05:38PM (#26020134)
https://arrow.apache.org/docs/js/ has existed for a while and uses typed arrays under the hood. It's a bit of a chunky dependency, but if you're at the point where that level of throughput is required bundle size is probably not a big deal.
Re:Apache Arrow 3.0 by liminal on Wednesday February 03, 2021 @05:48PM (#26020261)
I was mostly looking at this: https://arrow.apache.org/docs/status.html
Re:Apache Arrow 3.0 by BadInformatics on Wednesday February 03, 2021 @05:59PM (#26020358)
Not sure I follow, that page indicates that JS support is pretty good for all but the more obscure features (e.g. decimals) and doesn't mention data visualization at all? Anyhow, I've successfully used https://github.com/vega/vega-loader-arrow for in-browser plots before, and Observable has a fair few notebooks showing how to use the JS API (e.g. https://observablehq.com/@theneuralbit/introduction-to-apach...)