News for hackers. Stuff that matters.
Re:Bookmarking is more complex than you think by bravura on Friday May 17, 2013 @05:17PM (#5726748)
Is there an open-source library for archiving a URL, including all assets (JS, graphics, etc.)?

This task is trickier than it initially seems.

I'd love to have a local cache of bookmarked URLs.

Re:Bookmarking is more complex than you think by icebraining on Friday May 17, 2013 @06:51PM (#5727078)
Wget can do it, with variable success.

I thought about building one in PhantomJS, since it seems it can extract all the required assets, but gave up on it since most of the content I care about is in my RSS archive anyway.

Re:Bookmarking is more complex than you think by notaddicted on Friday May 17, 2013 @11:56PM (#5727872)
Wget is good if you have the right options (http://psung.blogspot.com/2008/06/using-wget-or-curl-to-down...).

For some audio/video sites there is youtube-dl, there is a list of sites it handles here: http://rg3.github.io/youtube-dl/documentation.html .

EDIT: there is a writeup about that is partially based on wget here: http://www.gwern.net/Archiving%20URLs#local-caching (also includes extracting URL from firefox history)

EDIT2: and if you're really desperate you could always use tcpdump/mitmdump and something like this: http://justniffer.sourceforge.net/#!/justniffer_grab_http_tr...

Re:Bookmarking is more complex than you think by redidas on Friday May 17, 2013 @06:14PM (#5726951)
What about browser -> save as -> save as type "Website, complete"? Not really a library, and not really something you could do retro-actively to urls already bookmarked without revisiting the pages, but it sort of works.

Regarding a library for archiving a URL - it'd be interesting if there were a way to save a url by inline css and javascript in the html, and converting images and other assets to data urls.

Re:Bookmarking is more complex than you think by pbreit on Friday May 17, 2013 @05:42PM (#5726835)
If you don't mind free but closed source, Evernote.
Re:Bookmarking is more complex than you think by smacktoward on Friday May 17, 2013 @06:37PM (#5727028)
HTTrack (http://www.httrack.com/), maybe...