News for hackers. Stuff that matters.
Re:The Birth of Parquet by martinky24 on Wednesday May 08, 2024 @11:43AM (#40299395)
Wouldn't partial reads fix the RAM problem? e.g. something like this: https://stackoverflow.com/a/69888274

It might not be fast, but a quick 1-off solution that you let run for a while would probably do that job. There shouldn't be a need to load the whole file into memory.

There are no comments on this comment yet.