News for hackers. Stuff that matters.

A comment on SQLite as an Application File Format (2014). Parent comment

Re:SQLite as an Application File Format (2014) by mbrumlow on Tuesday December 25, 2018 @10:27AM (#18757727)
What size restrictions are you worried about ?

*Note I work with software that regularly stores terabytes of data in sqlite.

[ Parent | on HN ]
Re:SQLite as an Application File Format (2014) by anonymouzz on Tuesday December 25, 2018 @10:57AM (#18757836)
Heh I was thinking that > 1TiB of data in an sqlite db is a bad idea :).

How do you process that? The restrictions I had in my mind come from that it's infeasible to concurrently process a large dataset in mapreduce/bigquery style.

[ Parent | on HN ]
Re:SQLite as an Application File Format (2014) by mbrumlow on Tuesday December 25, 2018 @11:46PM (#18760582)
There are many different concurrence modules for sqlite. I can't see why you would have any problems with what you describe.

The systems I work with use it for backup data. We have many readers and writes. Some of those export a iscsi daemon that represents a block device from the backup that is then booted form.

[ Parent | on HN ]
Re:SQLite as an Application File Format (2014) by mbrumlow on Wednesday December 26, 2018 @01:52PM (#18763864)
spelling :(
[ Parent | on HN ]