News for hackers. Stuff that matters.
Re:SQLite is all you need for durable workflows by gchamonlive on Friday May 29, 2026 @03:49PM (#48328297)
Are logs all you need for durable workflows? I'm confused here. How'd persist and query nested or related data over logs? By logs I assume you mean something like elasticsearch or meilisearch?
Re:SQLite is all you need for durable workflows by wolttam on Friday May 29, 2026 @04:03PM (#48328466)
Pretty much every durable system has an intent log of some sort. The log provides durability, the database system just integrates that log into a more queryable format.
Re:SQLite is all you need for durable workflows by gchamonlive on Friday May 29, 2026 @06:35PM (#48330230)
I swear it didn't occur to me that that mean WAL, makes much more sense now LOL
Re:SQLite is all you need for durable workflows by fourside on Friday May 29, 2026 @04:26PM (#48328767)
I read the parents comment as sarcasm and not a serious suggestion.
Re:SQLite is all you need for durable workflows by deathanatos on Friday May 29, 2026 @04:48PM (#48329036)
I assume they meant a log like a WAL. A WAL should be (quite literally?) all you need for durable workflows.

A distributed WAL (to survive a machine death) would also probably be something I'd want, and … something I'm not sure you're getting directly from SQLite.

Re:SQLite is all you need for durable workflows by gchamonlive on Friday May 29, 2026 @06:32PM (#48330196)
Is it common to use logs as a proxy for write-ahead logs?
Re:SQLite is all you need for durable workflows by gchamonlive on Saturday May 30, 2026 @07:26AM (#48335067)
Folks this is meant to be an honest question, not a snarky comment. I'm not a DBA, I'm DevOps/SRE and logs for me always meant execution logs. I'm just curious if between those involved in database domain logs is used to refer to WAL.
Re:SQLite is all you need for durable workflows by atreids on Saturday May 30, 2026 @05:59PM (#48341011)
I think the original poster in this thread was joking. A fair number of databases use "logs" as a core mechanism for storing and sorting data. "Logs" in this context is not to be confused with stdout/stderr output that you may collect from a running program and forward somewhere like Cloudwatch/Elasticsearch etc. "Logs" in the context of databases here refers to the data structure; which can generally be defined as simply an append-only "file" (I put file in quotes because just because something is a log does not mean it is necessarily written to disk yet - that's why write-ahead logs exist). It's not just write-ahead logs.

Google "Log-structured merge trees" if you want an interesting read.

Re:SQLite is all you need for durable workflows by Rapzid on Friday May 29, 2026 @05:33PM (#48329603)
Log as in the structure.