News for hackers. Stuff that matters.
Re:Wayback Machine director outlines the scale of everyone's... by klodolph on Wednesday October 10, 2018 @03:05PM (#18187919)
This seems pretty obvious to me once you say it, I guess I didn't understand what you were trying to say. It seems like that goes both ways, too... what I'm trying to say is that the amount of reconstruction work increases as the encoding size increases. You're offering suggestions for how to accomplish that work but it doesn't change the underlying fact that wider encodings require more work for reconstruction.

And that really was all I was trying to say... you don't make encodings arbitrarily wide because the space savings must be weighed against the reconstruction costs.

Re:Wayback Machine director outlines the scale of everyone's... by Dylan16807 on Wednesday October 10, 2018 @04:03PM (#18188359)
Not arbitrarily wide, agreed. But it's also true that you can go a lot wider than a typical raid array without much difficulty.

I guess something to keep in mind is that you need bigger chunks to read efficiently, and smaller stripes to write efficiently. But in archival storage you don't care about write speed so the balance changes a lot.