News for hackers. Stuff that matters.

A comment on Show HN: Tesoro – Personal internet archive. Parent comment

Re:Show HN: Tesoro – Personal internet archive by Faaak on Tuesday June 27, 2017 @09:11AM (#14645016)
How about avoiding redundancies ? Are same CSS files cached twice or referenced by their hash ?

The page URI is a bit obscure though. I think a tresoro.io/example.tld/page/foobar/timestamp would look good.

What about big media content and/or small differences between them ?

[ Parent | on HN ]
Re:Show HN: Tesoro – Personal internet archive by agamble on Tuesday June 27, 2017 @09:31AM (#14645181)
Great question.

Currently there is no global redundancy checking, only locally within the same page. So two CSS files which are the same from multiple archives are both kept. While this might not be ideal in terms of scaling to infinity, each archive + its dependencies are right now limited in size to 25MB, which should help keep costs under control until this is monetised. :)

[ Parent | on HN ]
Re:Show HN: Tesoro – Personal internet archive by WhiteOwlLion on Tuesday June 27, 2017 @03:15PM (#14648375)
What file system are you using? Couldn't a deduplicating file system handle redundancy for you?
[ Parent | on HN ]