News for hackers. Stuff that matters.

A comment on Apache Arrow 3.0. Parent comment

Re:Apache Arrow 3.0 by poorman on Wednesday February 03, 2021 @04:40PM (#26019520)
Not only in between processes, but also in between languages in a single process. In this POC I spun up a Python interpreter in a Go process and pass the Arrow data buffer between processes in constant time. https://github.com/nickpoorman/go-py-arrow-bridge
[ Parent | on HN ]
Re:Apache Arrow 3.0 by cdash on Wednesday February 03, 2021 @06:33PM (#26020670)
How is this any better than something like flatbuffers though?
[ Parent | on HN ]
Re:Apache Arrow 3.0 by mrfox321 on Wednesday February 03, 2021 @07:03PM (#26020929)
For one, Arrow is columnar.

The idea of zero-copy serialization is shared between Arrow and FlatBuffers.

[ Parent | on HN ]
Re:Apache Arrow 3.0 by asperous on Wednesday February 03, 2021 @11:51PM (#26022729)
This is explained in the FAQS for Arrow, saying they use flatbuffers internally. Arrow supports more complex data types
[ Parent | on HN ]
Re:Apache Arrow 3.0 by tomnipotent on Thursday February 04, 2021 @01:23AM (#26023146)
> saying they use flatbuffers internally

Only for IPC support - Arrow data format does not use flatbuffers.

[ Parent | on HN ]