News for hackers. Stuff that matters.

A comment on The fastest tool for querying large JSON files is written in Python (benchmark). Parent comment

Re:The fastest tool for querying large JSON files is written... by cube2222 on Friday April 15, 2022 @06:05AM (#31038393)
No worries! I think it'll be most fair if I just let you know when these are fixed, and you can properly use them, performantly, with a sane output option (that's not stream native, but something like JSON). I.e. LIMIT won't work with stream_output.

If you want to add it to the first one, I won't oppose, but don't feel pressured to do it. Especially the third query does highlight a very realistict limitation of OctoSQL as it works right now, so it's only fair as it is.

[ Parent | on HN ]
Re:The fastest tool for querying large JSON files is written... by cube2222 on Friday April 15, 2022 @03:38PM (#31044807)
I've just released OctoSQL v0.6.0 which fixes the issue and adds eagerly printed CSV and JSON output, as well as a non-buffered LIMIT implementation. It's now just slightly slower in the benchmark than SPyQL.

Thanks for the motivation!

[ Parent | on HN ]