News for hackers. Stuff that matters.

A comment on Apache Arrow 3.0. Parent comment

Re:Apache Arrow 3.0 by jzer0cool on Wednesday February 03, 2021 @08:22PM (#26021462)
I'm curious too. Does this mean data is first normalized into this "columnar format" as the primary source and all applications are purely working off this format?

I do see yet clearly how the data is being transferred if no serializing/deserializing is taking place if someone here can help fill in further. It almost sounds like there is some specialized bridge for the data transfer and I don't have the right words for it.

[ Parent | on HN ]
Re:Apache Arrow 3.0 by alisonkisk on Wednesday February 03, 2021 @11:31PM (#26022610)
I think you've got it. Data is shared by passing a pointer to it, so the data doesn't need to be copied to different spots in memory (or if it is it's an efficient block copy not millions of tiny copies).
[ Parent | on HN ]