News for hackers. Stuff that matters.
Re:Appropriate Uses for SQLite by dijit on Monday February 12, 2018 @07:23AM (#16358163)
That does not mirror my experience, I hate to be the guy suggesting this but have you considered the fact that you're using it wrong?

What I mean by that is that SQLite really is a replacement for open() and as such is not multi-thread compatible. If you're doing a lot of work that's corrupting you can also turn up the level of binary logging until recovery becomes easy enough.

I'm using SQLite effectively on a few thousand multi-threaded windows machines and I've encountered corruption exactly once- which was when a hardware raid had degraded non-gracefully.

Re:Appropriate Uses for SQLite by jpeeler on Monday February 12, 2018 @11:16AM (#16359592)
My understanding is that using SQLite is completely fine in a multithreaded architecture, but you have to ensure that the simultaneous database operations match the correct threading mode:

https://sqlite.org/threadsafe.html

I also believe that the common way of gaining performance while protecting safety is to use multi-thread mode with connection pooling. The idea being that your application can use different database connections to achieve multiple writes without relying on the overhead of additional locking required within SQLite itself for serialized mode.

Would be interesting if anybody has performance metrics that backs up what I said with data converging on an optimum number of database connections.

Re:Appropriate Uses for SQLite by dijit on Monday February 12, 2018 @11:42AM (#16359799)
that's exactly the case; make sure only one thread writes, but how you feed data to that thread is up to you.
Re:Appropriate Uses for SQLite by karmicthreat on Monday February 12, 2018 @08:04AM (#16358310)
Oh I guarantee I am doing something wrong. This is running on some crappy sandisk sd cards as well. So it is entirely possible that the corruption I run into is just an issue with the sd card.