News for hackers. Stuff that matters.
Re:Why isn’t there a decent file format for tabular data? by simonw on Tuesday May 03, 2022 @06:42PM (#31254517)
SQLite is one of the few file formats that's recommended by the US Library of Congress for archival storage: https://www.loc.gov/preservation/digital/formats/fdd/fdd0004...

See also this page on the SQLite website (they're understandably very proud of this): https://www.sqlite.org/locrsf.html

I think it's a fantastic format for archiving and distributing data.

Re:Why isn’t there a decent file format for tabular data? by Banana699 on Wednesday May 04, 2022 @12:03AM (#31256614)
I honestly love SQLlite, so many things about this database are refreshingly amazing. The lightweight embedded nature, the extreme ubiquity[1], the single-source-file-to-compile idea[2], the gigantic test suite[3], their commitment to stability and backward compatability[4], etc ...

Simply a modern marvel of engineering. A thing to put on the next Voyager and send to aliens as a representative of what human minds and hands can do.

[1] https://www.sqlite.org/mostdeployed.html

[2]https://www.sqlite.org/amalgamation.html

[3] https://www.sqlite.org/testing.html

[4]https://www.sqlite.org/lts.html

Re:Why isn’t there a decent file format for tabular data? by euroderf on Wednesday May 04, 2022 @10:46AM (#31261202)
All I'd want is a CLI tool that can dump an SQLite file so that it actually looks like a table (using "|", "-", "+", etc.), and maybe also accept grep-style filter specs (per specified column[s] of course).
Re:Why isn’t there a decent file format for tabular data? by tschan on Wednesday May 04, 2022 @11:51AM (#31262156)
This sounds like an interesting weekend project. Are you saying you can't find anything for this?
Re:Why isn’t there a decent file format for tabular data? by euroderf on Wednesday May 04, 2022 @12:40PM (#31262811)
There is catsql[1] but it barfs in my Python environment.

[1]https://github.com/paulfitz/catsql

Re:Why isn’t there a decent file format for tabular data? by aldonius on Thursday May 05, 2022 @05:46PM (#31278735)
you can get a long way with something like

$ echo "<sqlite3 commands / sql queries>" | sqlite3 FILE

Re:Why isn’t there a decent file format for tabular data? by rileytg on Tuesday May 03, 2022 @06:53PM (#31254622)
sqlite also has roots in the us military (navy iirc). this could explain the US govs willingness to adopt.
Re:Why isn’t there a decent file format for tabular data? by tptacek on Tuesday May 03, 2022 @08:50PM (#31255526)
The LOC page explains why they recommend SQLite.

https://www.loc.gov/preservation/digital/formats/fdd/fdd0004...