Re:Uber Migrates 1T Records from DynamoDB to LedgerStore to ...
by mickeyp on Monday May 20, 2024 @07:56AM
(#40414483)
Would you care to tell us what your backup and restore policy would be for 1.7 PB of data?
[ Parent
| on HN ]
Re:Uber Migrates 1T Records from DynamoDB to LedgerStore to ...
by thangngoc89 on Monday May 20, 2024 @08:03AM
(#40414527)
I'm replying to the question of how one would replicate SQLite 3 in production for redundancy. I myself consider 10GB would be the limit for using SQLite 3 in read/write in production and switch to PostgreSQL.
Re:Uber Migrates 1T Records from DynamoDB to LedgerStore to ...
by sgt on Monday May 20, 2024 @09:14AM
(#40415110)
That's a huge discrepancy. One half of HN wants to put petabytes on SQLite, while your limit is only 10GB.
Re:Uber Migrates 1T Records from DynamoDB to LedgerStore to ...
by Closi on Monday May 20, 2024 @10:21AM
(#40415753)
Why not use SQLite's own guidance on where SQLite probably isn't appropriate:
- Client/Server applications (Check)
- High-volumes (Check)
- Large datasets (Check)
- High concurrency, particularly for writes (Check)
Re:Uber Migrates 1T Records from DynamoDB to LedgerStore to ...
by squeaky-clean on Tuesday May 21, 2024 @03:12AM
(#40425109)
There's only one person in this thread trying to put petabytes in SQLite. Everyone else is telling them the myriad reasons why it's a terrible idea.