Re:Why isn’t there a decent file format for tabular data?
by Banana699 on Wednesday May 04, 2022 @12:03AM
(#31256614)
I honestly love SQLlite, so many things about this database are refreshingly amazing. The lightweight embedded nature, the extreme ubiquity[1], the single-source-file-to-compile idea[2], the gigantic test suite[3], their commitment to stability and backward compatability[4], etc
...
Simply a modern marvel of engineering. A thing to put on the next Voyager and send to aliens as a representative of what human minds and hands can do.
[1] https://www.sqlite.org/mostdeployed.html
[2]https://www.sqlite.org/amalgamation.html
Re:Why isn’t there a decent file format for tabular data?
by euroderf on Wednesday May 04, 2022 @10:46AM
(#31261202)
All I'd want is a CLI tool that can dump an SQLite file so that it actually looks like a table (using "|", "-", "+", etc.), and maybe also accept grep-style filter specs (per specified column[s] of course).
Re:Why isn’t there a decent file format for tabular data?
by tschan on Wednesday May 04, 2022 @11:51AM
(#31262156)
This sounds like an interesting weekend project. Are you saying you can't find anything for this?
Re:Why isn’t there a decent file format for tabular data?
by euroderf on Wednesday May 04, 2022 @12:40PM
(#31262811)
There is catsql[1] but it barfs in my Python environment.
Re:Why isn’t there a decent file format for tabular data?
by aldonius on Thursday May 05, 2022 @05:46PM
(#31278735)
you can get a long way with something like
$ echo "<sqlite3 commands / sql queries>" | sqlite3 FILE
Re:Why isn’t there a decent file format for tabular data?
by rileytg on Tuesday May 03, 2022 @06:53PM
(#31254622)
sqlite also has roots in the us military (navy iirc). this could explain the US govs willingness to adopt.
Re:Why isn’t there a decent file format for tabular data?
by tptacek on Tuesday May 03, 2022 @08:50PM
(#31255526)
The LOC page explains why they recommend SQLite.
https://www.loc.gov/preservation/digital/formats/fdd/fdd0004...
See also this page on the SQLite website (they're understandably very proud of this): https://www.sqlite.org/locrsf.html
I think it's a fantastic format for archiving and distributing data.