News for hackers. Stuff that matters.
Re:LiteFS a FUSE-based file system for replicating SQLite by tantaman on Tuesday July 26, 2022 @02:45PM (#32242246)
Very cool. I've been working on CRDTs for SQLite to allow for conflict-free replication. Its still super early but I have a prototype that works and, if you're up to it, I would love to pick your brain on the details of sqlite WALs and journaling.

https://www.loom.com/share/0934f93364d340e0ba658146a974edb4

Re:LiteFS a FUSE-based file system for replicating SQLite by benbjohnson on Tuesday July 26, 2022 @02:57PM (#32242406)
Right on, I always thought a CRDT SQLite database would be awesome. I thought about looking at the session extension[1] to handle the merges but I didn't get very far into it.

Feel free to ping me at [email protected] if you want to chat WAL & journaling. I think it'd be difficult to implement CRDT at the journal level since it's all physical pages. Merging data in pages is going to sometimes cause splits and that'll be hairy to deal with.

[1] https://www.sqlite.org/sessionintro.html

Re:LiteFS a FUSE-based file system for replicating SQLite by tantaman on Tuesday July 26, 2022 @03:19PM (#32242707)
that was my assumption but it's been suggested a few times to implement it there. Nice to hear some validation that that isn't a great spot.