News for hackers. Stuff that matters.
Re:How the SQLite virtual machine works by endisneigh on Wednesday September 07, 2022 @06:12PM (#32757727)
> Still, you didn't define it. What's the data schema? What is the application? I don't know what to say, if your app is a TODO list app that's wildly popular, then I guarantee I can do what you want with SQLite easily. If it's Spotify-level stuff with special aggregation and data analysis, maybe not?

sigh. any app based on SQLite with more than 1 million concurrent users, 75% reads.

Re:How the SQLite virtual machine works by ok_dad on Wednesday September 07, 2022 @06:23PM (#32757892)
Here's one specific one, I would imagine they have a pretty big user base: https://tailscale.com/blog/database-for-2022/

Here are a few other sources I googled:

https://www.sqlite.org/famous.html

https://stackshare.io/sqlite

This is the best I can do, because I have no idea what else you want. If I had the time, I could throw up a simulated million users doing a TODO app with SQLite as the backing DB engine, but I don't have time, I have a 2 year old. Do your own research from here, or don't and just use Postgres until you retire, I don't really care that much.

Re:How the SQLite virtual machine works by tptacek on Wednesday September 07, 2022 @06:57PM (#32758287)
A million concurrent, with a database-backed website? Is that a useful threshold? How many monthly actives is a million concurrent? And, at that scale, is your database your gating factor, or is app architecture?
Re:How the SQLite virtual machine works by kasey_junk on Wednesday September 07, 2022 @07:07PM (#32758405)
Can you name a single application that has 250k concurrent writes (per second I assume as you didn’t stipulate) using a consistent sql backend (that is no external caching/sharing layer)?

I don’t think your example is a good fit for SQLite as it’s not a good fit for any sql store that I know of.

Re:How the SQLite virtual machine works by rrdharan on Wednesday September 07, 2022 @08:10PM (#32759171)
Uber, on Google Cloud Spanner, seems to be in this ballpark though they aren’t quite explicit about it:

https://www.uber.com/blog/building-ubers-fulfillment-platfor...

Re:How the SQLite virtual machine works by kasey_junk on Wednesday September 07, 2022 @09:56PM (#32760070)
Spanner is explicitly sharded. Sort of famously so.
Re:How the SQLite virtual machine works by rrdharan on Thursday September 08, 2022 @12:50AM (#32761311)
All scale out databases use some form of sharding, tautologically.

The parent asked about use cases where there wasn’t an _external_ (which I interpret to mean “handled explicitly by the app, not the database”) sharding / caching layer.

Spanner internally handles splits based on load / size.

That having been said, more careful reading of the Uber post shows that they still do employ additional app-level explicit sharding to resolve hot-spots, so it’s probably a fair point that this doesn’t qualify as an example the parent was looking for.

Re:How the SQLite virtual machine works by endisneigh on Wednesday September 07, 2022 @08:56PM (#32759611)
A few vendors doing time series data. Even if you lowered it a couple orders of magnitude. I haven’t seen any app doing even 5K concurrent writes backed by SQLite.
Re:How the SQLite virtual machine works by kasey_junk on Wednesday September 07, 2022 @09:55PM (#32760061)
What time series vendor is offering high write throughput consistent sql?

Legitimately interested as this is something I have more than a little professional interest.

That said, “show me an app doing 5k concurrent writes with SQLite” seems like a much more reasonable standard.

Re:How the SQLite virtual machine works by lenkite on Thursday September 08, 2022 @12:21AM (#32761158)
Don't even bother with a million. Even 1k concurrent users with 75% read/25% write is not something plain SQLite can handle without significant latency compared to Postgres.
Re:How the SQLite virtual machine works by Scarbutt on Wednesday September 07, 2022 @06:32PM (#32758013)
sigh. any app based on SQLite with more than 1 million concurrent users, 75% reads.

Definitely not the use case for SQLite unless you can easily do sharding but as you said, why bother?