News for hackers. Stuff that matters.

A comment on Big data is dead (2023). Parent comment

Re:Big data is dead (2023) by devsda on Monday May 27, 2024 @10:33AM (#40491090)
This is such a simple scheme.

I wonder how they dealt with common storage issues like backups and disks having bad sectors.

[ Parent | on HN ]
Re:Big data is dead (2023) by giantrobot on Monday May 27, 2024 @01:00PM (#40492555)
They're likely record based formatting rather than file based. At the high level the code is just asking for a record number from a data set. The data set is managed including redundancy/ECC by the hardware of that storage device.
[ Parent | on HN ]