News for hackers. Stuff that matters.
Re:The fastest tool for querying large JSON files is written... by dmoura on Friday April 15, 2022 @05:59AM (#31038350)
Thanks @cube2222! Great! Sorry for overlooking that option. I will definitely add that option to octosql to make the comparison fair. Should I add it to the 3 queries?
Re:The fastest tool for querying large JSON files is written... by cube2222 on Friday April 15, 2022 @06:05AM (#31038393)
No worries! I think it'll be most fair if I just let you know when these are fixed, and you can properly use them, performantly, with a sane output option (that's not stream native, but something like JSON). I.e. LIMIT won't work with stream_output.

If you want to add it to the first one, I won't oppose, but don't feel pressured to do it. Especially the third query does highlight a very realistict limitation of OctoSQL as it works right now, so it's only fair as it is.

Re:The fastest tool for querying large JSON files is written... by cube2222 on Friday April 15, 2022 @03:38PM (#31044807)
I've just released OctoSQL v0.6.0 which fixes the issue and adds eagerly printed CSV and JSON output, as well as a non-buffered LIMIT implementation. It's now just slightly slower in the benchmark than SPyQL.

Thanks for the motivation!