Re:The fastest tool for querying large JSON files is written...
by dmoura on Monday April 18, 2022 @05:13AM
(#31068728)
The initial idea was to focus on cmd line tools... I added pandas for comparison, as it is one of the most used libs to work with datasets. I will either remove Pandas from the equation or add Polars. By the way, I run some benchmarks and polars seems a bit faster than spyql for the aggregation challenge, but does not scale (loads everything into memory)
[0] -- https://www.pola.rs/ [1] -- https://h2oai.github.io/db-benchmark/