Re:Wayback Machine director outlines the scale of everyone's...
by Dylan16807 on Wednesday October 10, 2018 @04:03PM
(#18188359)
Not arbitrarily wide, agreed. But it's also true that you can go a lot wider than a typical raid array without much difficulty.
I guess something to keep in mind is that you need bigger chunks to read efficiently, and smaller stripes to write efficiently. But in archival storage you don't care about write speed so the balance changes a lot.
And that really was all I was trying to say... you don't make encodings arbitrarily wide because the space savings must be weighed against the reconstruction costs.