News for hackers. Stuff that matters.
Re:Analyzing multi-gigabyte JSON files locally by saidinesh5 on Saturday March 18, 2023 @01:53PM (#35211433)
> * "You might find out that the data doesn’t fit into RAM (which it well might, JSON is a human-readable format after all)" -- if I'm reading this right, the author is saying that the parsed data takes _more_ space than the JSON version? JSON is a text format and interning it into proper data structures is likely going to take _less_ space, not more.

Not to mention, even when using bad data structures (eg. hashmap of hashmaps..), One can just add a large enough swapfile and brute force their way through it no?

Re:Analyzing multi-gigabyte JSON files locally by samus on Sunday March 19, 2023 @04:50AM (#35217188)
This will fail if the algorithm is not O(n). Even if only a bounded number of passes is required, there will be trouble.