Re:Wayback: Self-hosted archiving service integrated with In...
by bomewish on Sunday April 16, 2023 @03:38AM
(#35588052)
Gotta agree that it's really darn confusing as to what this thing actually does. Seems like a pretty big project that some talented people have poured a lot of time into, but what am I getting into here?
Does it (1) download archived urls already on archive.org locally? or (2) spider websites I choose from scratch and save them locally (or on archive.org??)
Totally unclear. These are very different things. Want to install and try it but also a little wary given the opacity of explanation about the basic functionality and purpose of the tool!
Re:Wayback: Self-hosted archiving service integrated with In...
by navigate8310 on Sunday April 16, 2023 @04:39AM
(#35588271)
Why is this better than simply passing a cURL such as archive.today/example.com/post1
Re:Wayback: Self-hosted archiving service integrated with In...
by pastage on Sunday April 16, 2023 @03:32AM
(#35588024)
> Chromium: Wayback uses a headless Chromium to capture web pages for archiving purposes. [0]
I think it is a local spider. This quote is the only clear indication that they actually spider themselves. There are lots of implicit statements as well.
Re:Wayback: Self-hosted archiving service integrated with In...
by wabarc on Monday April 17, 2023 @10:43AM
(#35601495)
Correct, wayback has implemented remote and local archiving of various types of resources, including HTML, PDF, HAR, WARC, Readability (Markdown and Txt), and media files such as images, videos, and audio.
> Wayback one or more url to Internet Archive and archive.today
> Wayback url to Internet Archive or archive.today or IPFS
Correct me if I’m wrong but… does this forward links to those services and does not actually run the archiving process locally? In that case I would make the argument that it’s not really what self-hosted conveys.