News for hackers. Stuff that matters.

A comment on Open table formats are inevitable for analytical datasets.

Re:Open table formats are inevitable for analytical datasets by the_duke on Thursday January 18, 2024 @05:28AM (#39040126)
Is there any such open source table format for row based data?

I've been dabbling with implementing a database, and adopting a format would be much easier.

[ Parent | on HN ]
Re:Open table formats are inevitable for analytical datasets by codeaken on Thursday January 18, 2024 @06:53AM (#39040671)
Apache AVRO [1] is one but it has been largely replaced by Apache Parquet [2] which is a hybrid row/columnar format

[1] https://avro.apache.org/

[2] https://parquet.apache.org/

[ Parent | on HN ]
Re:Open table formats are inevitable for analytical datasets by chimerasaurus on Thursday January 18, 2024 @10:07AM (#39042572)
As a note, Iceberg also supports AVRO in addition to Parquet (and ORC).
[ Parent | on HN ]
Re:Open table formats are inevitable for analytical datasets by dist-epoch on Thursday January 18, 2024 @06:53AM (#39040672)
SQLite is something like that.
[ Parent | on HN ]