News for hackers. Stuff that matters.
Re:Show HN: ZSV (Zip Separated Values) columnar data format by hafthor on Saturday April 13, 2024 @09:18PM (#40027838)
Thanks for taking a look. Regarding seekable columns, that's the reason why I use the ZIP file format. It has a central directory at the end of the ZIP file that has locations to each file inside, making it so you can seek to a specific column file to extract.
Re:Show HN: ZSV (Zip Separated Values) columnar data format by makmanalp on Sunday April 14, 2024 @01:19AM (#40028842)
Oh interesting - I missed that tidbit! So with that and row groups and the metadata (assuming you have one metadata block per column in each row group) I think you get to full seekability, right?