Re:Why SQLite Is Taking over with Brian Holt and Marco Bambini
by jitl on Wednesday June 12, 2024 @09:14AM
(#40657777)
You can incrementally read or write the value in a BLOB column of a row. You can read/write etc using a file descriptor like API: https://www.sqlite.org/c3ref/blob_open.html
Re:Why SQLite Is Taking over with Brian Holt and Marco Bambini
by jhanschoo on Tuesday June 18, 2024 @10:04PM
(#40724077)
Thanks, I did a quick google for something like this before writing my comment, but your link did not come up.
Re:Why SQLite Is Taking over with Brian Holt and Marco Bambini
by OskarS on Wednesday June 12, 2024 @09:22AM
(#40657848)
It's very easy to design a schema that breaks up blobs into chunks. SQLite is excellent for memory constrained environments, with even mathematical proofs of maximum memory usage: https://www.sqlite.org/malloc.html
The article discusses storing files as BLOBs. But it looks to me like this isn't a good fit for sufficiently memory-constrained environments, given a task involving processing a very large file in a sequential manner, like with media reencoding, or video playback. It seems like the traditional file access patterns are better suited for those tasks.