News for hackers. Stuff that matters.
Re:How Websites Die by EddieDante on Wednesday June 29, 2022 @03:26PM (#31924632)
> I've also been working on a background process that automatically captures full-resolution screenshots of every website you visit, creating your own searchable personal web archive:

How are screenshots searchable? They aren't plain text. You can't grep them.

Re:How Websites Die by Jaxan on Wednesday June 29, 2022 @03:41PM (#31924806)
Why not though. On MacOS you can select text in bitmaps nowadays. So the tech is there to make a grep for pictures.
Re:How Websites Die by anonymoushn on Wednesday June 29, 2022 @03:38PM (#31924781)
The tool captures screenshots in addition to text.
Re:How Websites Die by doodles33 on Wednesday June 29, 2022 @03:42PM (#31924818)
That seems awfully simillar to archive.org wayback machine. I do like to see all these archival projects though, they are certainly worthwhile.
Re:How Websites Die by lazyjeff on Wednesday June 29, 2022 @05:03PM (#31925677)
irchiver captures text on the page, and separately OCRs the screenshots (specifically, the screenshot from your viewport). So you can search just what was shown on the page, or what was in the page. Both techniques have pros and cons.

While archive.org is fantastic, it can only capture pages that are both 1) publicly accessible (i.e. no social media content) that it happens to crawl, and 2) static content (you're out of luck if the content you want is loaded dynamically, or changes depending on user input).

Re:How Websites Die by pabs3 on Thursday June 30, 2022 @01:29AM (#31928971)
IIRC archive.org does save the JS and things it downloads, so you can replay them when you visit the archived site later.
Re:How Websites Die by doodlesdev on Thursday June 30, 2022 @10:17PM (#31941434)
I guess the difference in this case is that the JS on web archive relies on future browsers being backwards compatible, whereas irchiver relies on much less to stay timeless which is good. Although I don't think JavaScript will ever get a major update (as in breaking comparability) I believe relying on that is not a perfect way to archive web content. This kind of backwards compatibility breakage is something we have seen before with the deprecation of Adobe Flash and it could theoretically happen elsewhere on the web stack.
Re:How Websites Die by pabs3 on Thursday June 30, 2022 @11:43PM (#31942086)
Agreed, I wish they would archive the DOM too like archive.is does instead of just the requests.