Re:Show HN: ZSV (Zip Separated Values) columnar data format
by hafthor on Saturday April 13, 2024 @09:18PM
(#40027838)
Thanks for taking a look. Regarding seekable columns, that's the reason why I use the ZIP file format. It has a central directory at the end of the ZIP file that has locations to each file inside, making it so you can seek to a specific column file to extract.
[ Parent
| on HN ]
Re:Show HN: ZSV (Zip Separated Values) columnar data format
by makmanalp on Sunday April 14, 2024 @01:19AM
(#40028842)
Oh interesting - I missed that tidbit! So with that and row groups and the metadata (assuming you have one metadata block per column in each row group) I think you get to full seekability, right?