News for hackers. Stuff that matters.
Re:The fastest tool for querying large JSON files is written... by sandGorgon on Friday April 15, 2022 @09:02AM (#31039712)
Store the json in postgresql as JSONB.

Not trying to flame - I do realise that duckdb is an alternative, but everyone in this space does this

Especially for data scientists, etc. The tooling flow around dbt, pandas, jupyter, postgresql and json is rock solid.

Re:The fastest tool for querying large JSON files is written... by boredumb on Friday April 15, 2022 @09:32AM (#31040034)
I can second that using JSONB with postgres is fast and easy, the features and operators to query json structures are also about as extensive as you'll ever need.
Re:The fastest tool for querying large JSON files is written... by gavinray on Friday April 15, 2022 @12:48PM (#31042453)
Thirded, though DuckDB is compelling for scenarios when you'd traditionally be able to use SQLite, if analytics/OLAP is your thing.

It's exciting and brilliant technology. I believe the authors are the same ones behind MonetDB.

Re:The fastest tool for querying large JSON files is written... by orlp on Friday April 15, 2022 @09:42AM (#31040117)
> Not trying to flame

Please, flame away. I'm not here to put up a fight for one approach or another, simply interested in hearing what people think works well and what doesn't; what they'd expect/want.

Re:The fastest tool for querying large JSON files is written... by anakaine on Friday April 15, 2022 @03:14PM (#31044475)
Probably best not to encourage fighting, since flaming is what an argument descends into when it starts to get directed and nasty.

How about "discuss away", heh.

Re:The fastest tool for querying large JSON files is written... by bachmeier on Friday April 15, 2022 @11:50AM (#31041589)
Wouldn't that require setting up and running a postgres server? DuckDB is an sqlite replacement.
Re:The fastest tool for querying large JSON files is written... by cryptonector on Friday April 15, 2022 @01:24PM (#31042912)
You could copy the JSONB code and not run PG.
Re:The fastest tool for querying large JSON files is written... by PaulHoule on Friday April 15, 2022 @09:26AM (#31039976)
arangodb for the win. I've done data analytics in it and OLTP.

You never hear hype about arangodb because arangodb users see it as a "secret weapon" and want their competitors to use mongo.