Re:What's New in SQLite 3.35
by avinassh on Saturday March 13, 2021 @10:10AM
(#26447045)
How does Litstream actually works? Do you read from WAL and then sync with S3?
[ Parent
| on HN ]
Re:What's New in SQLite 3.35
by benbjohnson on Saturday March 13, 2021 @12:06PM
(#26447917)
Yes, it reads off the WAL then compresses the frames using LZ4 and then uploads to S3. The SQLite WAL acts as a circular buffer so Litestream takes over the checkpointing process to control when it rolls over so it can recreate that buffer as separate files. There's additional information on the web site: https://litestream.io/how-it-works/