News for hackers. Stuff that matters.
Re:Store SQLite in Cloudflare Durable Objects by bob1029 on Tuesday January 25, 2022 @11:54AM (#30074184)
> But a lot of sites never get to that point, especially given how fast servers and SSDs are these days, so SQLite seems like it can get you further than you might realize.

SQLite on top of NVMe with WAL mode enabled is about as fast as it gets. We've been doing this in production for years now.

We don't have a scenario where we would find ourselves writing more than 2 gigabytes per second to DB/disk, nor do we ever think we would encounter one with our product, so we have committed ourselves to single instance SQLite architecture. Saves a lot of time and frustration when you can accept your circumstances and go all-in on simpler solutions.

Re:Store SQLite in Cloudflare Durable Objects by hu3 on Tuesday January 25, 2022 @12:22PM (#30074643)
I asked OP this and would appreciate your input as well.

What tool do you use to access production database remotely? Say you need to browse some data, perform queries. Is there something like pgAdmin?

I'm interested in SQLite and I'd like yo know more.

Re:Store SQLite in Cloudflare Durable Objects by bob1029 on Tuesday January 25, 2022 @02:07PM (#30076457)
We do not permit direct access to any application databases across any network. If something in one of our SQLite databases needs to be adjusted in an operational context, it needs to be done by way of some administrative interface that we have integrated into the product.

For offline troubleshooting/QA/Dev, we would simply grab a copy of the database from wherever and we would analyze it using DB Browser for SQLite. We actually use this tool so often that I felt it necessary to contribute to the author's Patreon account. It really is an amazing tool. Try reading/editing a binary field containing an image or other file in SSMS...

Having extreme discipline with your schema, queries, indexes, etc. is critical for being able to operate like this. If you are uncertain of what should live in what table, you probably just want to work against a hosted database engine until the whole team can agree on one standard path that you can burn into your codebase.

We did NOT start with SQLite for all the things. We had to make a lot of mistakes with hosted SQL providers before getting to this level of confidence.

Re:Store SQLite in Cloudflare Durable Objects by justinclift on Tuesday January 25, 2022 @03:24PM (#30077540)
> We actually use this tool so often that I felt it necessary to contribute to the author's Patreon account.

Thanks heaps for that btw!

Because of our Patrons, we've recently been able to buy an M1 Mac Mini. We should be able to start releasing ARM based macOS builds in the near-ish future. :)

Re:Store SQLite in Cloudflare Durable Objects by simonw on Tuesday January 25, 2022 @04:10PM (#30078072)
My application Datasette can serve this need: https://datasette.io/

Lots of live demos - two of my favourites are https://github-to-sqlite.dogsheep.net/ and https://global-power-plants.datasettes.com/

Re:Store SQLite in Cloudflare Durable Objects by Glench on Tuesday January 25, 2022 @12:26PM (#30074723)
I just scp the whole database to my local machine and use "db Browser for SQLite" (a mac app) :)

Would love to hear if there are other server-based db browsers for SQLite, though.

Re:Store SQLite in Cloudflare Durable Objects by Glench on Tuesday January 25, 2022 @12:24PM (#30074680)
Cool, what's your setup / workload look like?