News for hackers. Stuff that matters.
Re:Uber Migrates 1T Records from DynamoDB to LedgerStore to ... by mickeyp on Monday May 20, 2024 @07:56AM (#40414483)
Would you care to tell us what your backup and restore policy would be for 1.7 PB of data?
Re:Uber Migrates 1T Records from DynamoDB to LedgerStore to ... by thangngoc89 on Monday May 20, 2024 @08:03AM (#40414527)
I'm replying to the question of how one would replicate SQLite 3 in production for redundancy. I myself consider 10GB would be the limit for using SQLite 3 in read/write in production and switch to PostgreSQL.
Re:Uber Migrates 1T Records from DynamoDB to LedgerStore to ... by sgt on Monday May 20, 2024 @09:14AM (#40415110)
That's a huge discrepancy. One half of HN wants to put petabytes on SQLite, while your limit is only 10GB.
Re:Uber Migrates 1T Records from DynamoDB to LedgerStore to ... by Closi on Monday May 20, 2024 @10:21AM (#40415753)
Why not use SQLite's own guidance on where SQLite probably isn't appropriate:

- Client/Server applications (Check)

- High-volumes (Check)

- Large datasets (Check)

- High concurrency, particularly for writes (Check)

https://www.sqlite.org/whentouse.html

Re:Uber Migrates 1T Records from DynamoDB to LedgerStore to ... by squeaky-clean on Tuesday May 21, 2024 @03:12AM (#40425109)
There's only one person in this thread trying to put petabytes in SQLite. Everyone else is telling them the myriad reasons why it's a terrible idea.