News for hackers. Stuff that matters.
Re:SQLite as an Application File Format (2014) by radarsat1 on Saturday June 13, 2020 @02:55PM (#23511724)
Interesting, I used HDF5 in a similar situation because we needed to save a lot of same-sized rows of data (simulation time steps), so a matrix-oriented format seemed to make sense but it wasn't entirely without some need for cross-referencing between tables, so it does make me wonder now if sqlite would have been a comparable or better choice. Any reason for rejecting HDF5 in your case?
Re:SQLite as an Application File Format (2014) by st1ck on Sunday June 14, 2020 @12:40AM (#23515168)
Is it cheap to insert/update/delete data in HDF5? If not, that should be the answer. I'm also curious if Parquet would fit your requirements.