Re:ArchiveBox: Open-source self-hosted web archive
by gwern on Saturday March 09, 2019 @04:02PM
(#19348452)
> The generated index.html doesn't load css and js files. Or is this more for static content?
Why doesn't it do that? I thought that was the point of using Chrome as a headless browser to load all the dynamic elements into a final DOM so they could then be captured & serialized out: "ArchiveBox works by rendering the pages in a headless browser, then saving all the requests and fully loaded pages in multiple redundant common formats (HTML, PDF, PNG, WARC) that will last long after the original content dissapears off the internet."
Re:ArchiveBox: Open-source self-hosted web archive
by nikisweeting on Saturday March 16, 2019 @03:51PM
(#19409831)
It does that, it's possible it just broke on the page he tried. It doesn't work perfectly on 100% of pages which is why it saves as PDF, screenshot, and other methods as a fallback.
Re:ArchiveBox: Open-source self-hosted web archive
by narag on Sunday March 10, 2019 @01:15AM
(#19350662)
Is there some tool that would allow one to make a copy of a modern SPA?
If the interesting content is inside a database at the backend, copying the interface is not enough. You also want the database.
Re:ArchiveBox: Open-source self-hosted web archive
by nikisweeting on Saturday March 16, 2019 @03:53PM
(#19409838)
ArchiveBox is going to save all requests and responses with pywb in proxy mode, so it includes any data from the database that was needed to render the page.
Re:ArchiveBox: Open-source self-hosted web archive
by WrtCdEvrydy on Saturday March 09, 2019 @03:47PM
(#19348387)
Damn, this actually looks nice. I wonder if we can archive.
Is there some tool that would allow one to make a copy of a modern SPA? Is that even possible?
EDIT: I'm sad to see launchaco.com go, it would be a perfect tool for a project I'm working on. I don't mind paying, but I gather this is not possible anymore, and anyway, it might take some time for me to have everything ready...