News for hackers. Stuff that matters.
Re:A Journey building a fast JSON parser and full JSONPath, ... by beached_whale on Sunday July 05, 2020 @01:16PM (#23740235)
Are there benchmarks with simdjson getting the JSON reified into native data structures outside the parser?
Re:A Journey building a fast JSON parser and full JSONPath, ... by glangdale on Sunday July 05, 2020 @06:08PM (#23742518)
No. This is an interesting problem but a non-goal for the C++ version of simdjson, which produces usable "native data structures" albeit not outside the parser (speaking informally - the structures aren't really "in the parser" but they are specific to simdjson if you see what I mean).

The reification problem is awkward but it's a different problem for each language. I did daydream of breaking some API boundaries and using SIMD to magic up some Python structures directly, but this would be incredibly brittle. Someone would probably use it but the chance of getting burned by this is... high.

Re:A Journey building a fast JSON parser and full JSONPath, ... by jkeiser on Sunday July 05, 2020 @06:13PM (#23742562)
We have started experimenting how to do it with simdjson, though :) https://github.com/simdjson/simdjson/pull/947
Re:A Journey building a fast JSON parser and full JSONPath, ... by beached_whale on Sunday July 05, 2020 @06:22PM (#23742618)
Sorry, I meant the applications data structures and not the libraries. And C++ yes, at least that is my exposure to simdjson.