News for hackers. Stuff that matters.

A comment on S3 scales to petabytes a second on top of slow HDDs. Parent comment

Re:S3 scales to petabytes a second on top of slow HDDs by zenmac on Thursday September 25, 2025 @01:03AM (#45369423)
>Recently I've been looking into Garage and liking the idea of it, but it seems to have a very different design (no EC).

What you mean by no EC?

[ Parent | on HN ]
Re:S3 scales to petabytes a second on top of slow HDDs by crabique on Thursday September 25, 2025 @08:06AM (#45371851)
In their design document at https://garagehq.deuxfleurs.fr/documentation/design/goals/ they state: "erasure coding or any other coding technique both increase the difficulty of placing data and synchronizing; we limit ourselves to duplication"
[ Parent | on HN ]
Re:S3 scales to petabytes a second on top of slow HDDs by zenmac on Thursday September 25, 2025 @03:46PM (#45377997)
Nice! Learned something new today. Seems like a way for error correction. One can store parts of data with some more metadata and if some parts of the data are lost, the original can be reconstructed via some use of computational power.

Seems like some kind of compression?

Is that how the error correction on DVD works? I

And is that how GridFS is can keep file store slow low compare to regular file system?

[ Parent | on HN ]