News for hackers. Stuff that matters.

A comment on Parsing gigabytes of JSON per second. Parent comment

Re:Parsing gigabytes of JSON per second by Zababa on Saturday October 23, 2021 @08:38AM (#28967838)
> If your dataset is large enough to benefit from such a hyperoptimized parser

I don't understand that point. Is there an overhead in starting the parsing, which makes regular parsing faster unless you have a large JSON file? If not, why wouldn't you want faster JSON parsing?

[ Parent | on HN ]
Re:Parsing gigabytes of JSON per second by lumost on Saturday October 23, 2021 @08:56AM (#28967946)
Most languages have a built in parser these days, pulling in a c dep can be painful in many build tools and languages. The csimdjson api is sufficiently different to not as idiomatic. Most language json parsers are very fast already.

Personally I’m using csimdjson in a project with 100s of TB of json to burn through. This data should not be json formatted, but migrating away from json would require modifications to hundreds of different systems.

[ Parent | on HN ]
Re:Parsing gigabytes of JSON per second by Zababa on Saturday October 23, 2021 @09:06AM (#28968020)
That's a fair point. Though this could probably be used in interpreters/JIT/C++ projects, which is already a lot. And this gives a good template on how to optimize JSON parsing for other projects.
[ Parent | on HN ]