Re:Apache Arrow 3.0
by mushufasa on Wednesday February 03, 2021 @06:58PM
(#26020899)
is there a strong use case around passing data from a backend to a frontend, e.g. from pandas data frame on the server into a js implementation on the client side, to use in a UI? As opposed to data pipelining among processing servers.
[ Parent
| on HN ]
Re:Apache Arrow 3.0
by infinite8s on Thursday February 04, 2021 @08:34PM
(#26032026)
Yes definitely. For example, the perspective pivoting engine (https://github.com/finos/perspective) supports arrow natively, so you can stream arrow buffers from a big data system directly to be manipulated in your browser (treating the browser as a thick client application). It's a single copy from network buffer into the webassembly heap to get it into the library.
Re:Apache Arrow 3.0
by alisonkisk on Wednesday February 03, 2021 @11:33PM
(#26022622)
Not as much because you are still paying the overhead of doubt shipping across the internet and through the browser.