News for hackers. Stuff that matters.
Re:How arrow-rs is able to decode JSON so fast by necubi on Monday March 24, 2025 @07:40PM (#43466580)
I'm not very familiar with the internals of serde_json, but it's largely solving a different problem. Serde_json is deserializing individual records (rows), and typically using compile-time code generation. (Alternatively, it can also deserialize into fully-dynamic structures like serde_json::Value).

Arrow-json, by contrast, is doing columnar deserialization against a schema that's only known at runtime. To me, the interesting aspects of the design are how it does that performantly.

There are no comments on this comment yet.