Re:SQLite small blob storage: 35% Faster Than the Filesystem
by diroussel on Wednesday June 14, 2017 @03:21AM
(#14551183)
If you only want to read then both zip and tar are good for this purpose. It's commonly used and known to work well. There are many formats that are really just a renamed zip file. Like jar, and epub. File entries don't have to be compressed so you can mmap.
If you want to do random writes then more consideration is needed.
Re:SQLite small blob storage: 35% Faster Than the Filesystem
by imron on Wednesday June 14, 2017 @03:57AM
(#14551287)
> If you only want to read then both zip and tar are good for this purpose
And programmatically accessing them is significantly more complicated than using SQLite which involves dropping a single header in your project and about 10 lines of code.
> If you want to do random writes then more consideration is needed.
Which you almost certainly what you want to do for the sorts of use cases where SQLite is also under consideration.
Re:SQLite small blob storage: 35% Faster Than the Filesystem
by dkersten on Wednesday June 14, 2017 @05:14AM
(#14551509)
which involves dropping a single header in your project and about 10 lines of code.
10 lines of user code + the sqlite library. Using other formats like zip is hardly any more user code (+ some external library).
Re:SQLite small blob storage: 35% Faster Than the Filesystem
by imron on Wednesday June 14, 2017 @05:30AM
(#14551554)
The sqlite 'library' is a single header file and a single c file that you can just drop in your project and use.
It's not interacting with a file, it's interacting with a file that contains other files of varying sizes that need to be accessed randomly with good performance.