News for hackers. Stuff that matters.
Re:Show HN: Never lose a website again by pbhjpbhj on Wednesday July 02, 2014 @03:48PM (#7979232)
Do you just record n-grams indexed against the page url, are you then uploading that index? If you're not uploading it how is there no "local version" available?

It's an interesting idea. Personally I have a script that wgets all the pages I bookmark and I very rarely use that content. What use cases are you anticipating?

Re:Show HN: Never lose a website again by boyter on Wednesday July 02, 2014 @06:58PM (#7980372)
It would be useful for pulling back pages that have fallen off the internet and are not in the wayback machine.

Thats a use case I have hit a few times. I even started backing up useful posts just in case they died.

http://gigablast.com/rants.html is an example. Its a really good insight into the creation of a search engine which really should be preserved.

One that did dissapear but has since come back is this post http://widgetsandshit.com/teddziuba/2010/10/taco-bell-progra... which I went looking for a few years ago but had dissapeared from all search indexes.

Re:Show HN: Never lose a website again by ctrijueque on Wednesday July 02, 2014 @11:38PM (#7981313)
Pinboard offers an archival account (25$ a year) that works wonderfully for this. Take a look if you don't already know it.

https://pinboard.in/faq/#archiving

Re:Show HN: Never lose a website again by gwern on Wednesday July 02, 2014 @04:15PM (#7979429)
What does indexing mean here? I'm not sure what it means to 'index' but not 'store' webpages as the frontpage says.
Re:Show HN: Never lose a website again by pbhjpbhj on Wednesday July 02, 2014 @06:01PM (#7980058)
I assumed they meant that they extracted meta-data about the page (page mentions "Winnie the Pooh" for example, like a book index) and kept that associated with a key (eg URL) but didn't actually store the content per se. I was hoping the answer to my question would include that sort of detail - what's stored and where.
Re:Show HN: Never lose a website again by flippyhead on Thursday July 03, 2014 @01:31AM (#7981612)
That's exactly right. The indexed content is stored (as an inserted index) but not the plain text.