Re:Ask HN: What should a systems/low-level software engineer...
by janders on Friday January 11, 2019 @10:49AM
(#18884293)
My current go to for this is using SQLite. It's basically made for this purpose. If that doesn't serve, I like the idea of Apache Avro, but some of it's C++ bindings are a little lacking in my opinion.
[ Parent
| on HN ]
Re:Ask HN: What should a systems/low-level software engineer...
by StillBored on Friday January 11, 2019 @06:22PM
(#18888179)
This is a fantastic first choice, particularly as it sets you up for using a more "real" database for sharing data/scaling in the future.
OTOH, you have to know when no to use it and step up (down?) to something that is text editor hack-able (XML!?) or has barn burner I/O abilities (yah actually just dumping raw buffers with regularized binary data to disk). Or for that matter is used to exchange data with other apps with other services (JSON, and the long list of other data dependent formats, although for at rest exchange I have to point at XML again).
Re:Ask HN: What should a systems/low-level software engineer...
by sbr464 on Friday January 11, 2019 @07:54PM
(#18888708)
I agree, thanks for the reminder. As an example, I was working with Mass Spectrometry data recently, and found a list of about 20-30 possible formats for that topic alone (mostly proprietary) [0]
[0] https://en.wikipedia.org/wiki/Mass_spectrometry_data_format