Zero-copy deserialization in Julia

Re:Zero-copy deserialization in Julia by vvanders on Sunday September 02, 2018 @09:59AM (#17897013)

Flatbuffers is pretty great, one side benefit of these types of technologies is you can also use them to structure your memory accesses.

I've done this in Java to do cache aware reading to pretty great success.

[ Parent | on HN ]

Re:Zero-copy deserialization in Julia by vladf on Sunday September 02, 2018 @10:22AM (#17897084)

Do you mind elaborating?

[ Parent | on HN ]

Re:Zero-copy deserialization in Julia by blitmap on Sunday September 02, 2018 @11:20AM (#17897271)

I am not OP but I'm imagining data-oriented design. So like, things are structured and then serialized - and at some other end deserialized in place ready to read cache-coherently?

[ Parent | on HN ]

Re:Zero-copy deserialization in Julia by vvanders on Sunday September 02, 2018 @08:25PM (#17899421)

Yup pretty much. Zero-copy deserialization implies one large read into a block of memory(or mmap) which forces a specific layout. From there it's straightforward to follow standard data oriented design principals.

[ Parent | on HN ]