News for hackers. Stuff that matters.
Re:How arrow-rs is able to decode JSON so fast by necubi on Monday March 24, 2025 @07:42PM (#43466601)
The schema is only known at runtime, which prevents ahead-of-time code generation. JITing would be probably be an improvement though (at least in our use case, stream processing, where we're basically always willing to pay higher upfront costs for higher long-term performance).

(Actually, the original version of Arroyo was purely based around ahead-of-time code generation, and used serde_json for deserialization. I wrote at length why we decided to move away from that approach here: https://www.arroyo.dev/blog/why-arrow-and-datafusion).

There are no comments on this comment yet.