News for hackers. Stuff that matters.
Re:SQLite does not do checksums by joseangel_sc on Saturday November 09, 2024 @10:18AM (#42094849)
at the end it says most dbs don’t do this, except some, can someone tell me one that actually does it?
Re:SQLite does not do checksums by zX41ZdbW on Saturday November 09, 2024 @10:45AM (#42095004)
ClickHouse uses and validates checksums for both compressed blocks of data and uncompressed data; it also checksums and validates data during network transfers. Additionally, every replica validates checksums with other replicas when doing deterministic computations.

It is the only reasonable way to work with data, and if someone thinks otherwise, I will happily provide motivating examples.

Re:SQLite does not do checksums by hodgesrm on Saturday November 09, 2024 @12:28PM (#42095584)
Fully agree. There are many bad things that can happen to data. Another good feature is that ClickHouse is fairly tolerant of torn blocks and handles many failures automatically. This fault tolerance actually makes some corner cases hard to illustrate in demos, because ClickHouse repairs them silently. Users never see them.
Re:SQLite does not do checksums by ndxf on Saturday November 09, 2024 @10:27AM (#42094906)
PostgreSQL has data checksums, but the option is not enabled by default. More information at: https://www.postgresql.org/docs/current/checksums.html
Re:SQLite does not do checksums by rrdharan on Saturday November 09, 2024 @11:03AM (#42095111)
All the native storage systems at Google do it at every level (block, file, database); I would assume the same is true at AWS and Microsoft.
Re:SQLite does not do checksums by taffer on Saturday November 09, 2024 @10:39AM (#42094971)
Db2, Oracle, Postgres and SQL Server do checksums.
Re:SQLite does not do checksums by bakugo on Saturday November 09, 2024 @10:54AM (#42095050)
MySQL does it by default (or at least InnoDB does).