News for hackers. Stuff that matters.
Re:Show HN: Tesoro – Personal internet archive by agamble on Tuesday June 27, 2017 @09:31AM (#14645181)
Great question.

Currently there is no global redundancy checking, only locally within the same page. So two CSS files which are the same from multiple archives are both kept. While this might not be ideal in terms of scaling to infinity, each archive + its dependencies are right now limited in size to 25MB, which should help keep costs under control until this is monetised. :)

Re:Show HN: Tesoro – Personal internet archive by WhiteOwlLion on Tuesday June 27, 2017 @03:15PM (#14648375)
What file system are you using? Couldn't a deduplicating file system handle redundancy for you?