News for hackers. Stuff that matters.
Re:Apache Arrow and MinIO by thundergolfer on Sunday September 20, 2020 @08:24PM (#24538599)
I'd be interested to know any benefits of converting to Parquet if you know your reader supports Arrow.
Re:Apache Arrow and MinIO by lmeyerov on Sunday September 20, 2020 @09:53PM (#24539030)
Compression. For our app, we do multilevel caches, where warm is arrow (in-memory, inflight, streaming, ...) and cold (persistent/scaleout) is parquet (ssd, s3, ...).