HTTrack Website Copier

Re:HTTrack Website Copier by solardev on Tuesday March 18, 2025 @04:18PM (#43404530)

This doesn't really work with most sites anymore, does it? It can't run JavaScript (unlike headless browsers with Playwright/Puppeteer, for example), has limited supported for more modern protocols, etc.?

Any suggestions for an easy way to mirror modern web content, like an HTTrack for the enshittifed web?

[ Parent | on HN ]

Re:HTTrack Website Copier by vekatimest on Tuesday March 18, 2025 @04:33PM (#43404706)

ArchiveBox works decently with Javascript and uses a headless browser, can be deployed with Docker

[ Parent | on HN ]

Re:HTTrack Website Copier by n3storm on Tuesday March 18, 2025 @05:36PM (#43405436)

Which content/information sites dependant on javascript can be found? I always find marketing oriented or app interaction heavily using js and thus unable to archive...but otherwise...

[ Parent | on HN ]

Re:HTTrack Website Copier by vekatimest on Tuesday March 18, 2025 @09:33PM (#43407433)

Literally any modern social media, YouTube comments, anything using client-side rendering frameworks

[ Parent | on HN ]

Re:HTTrack Website Copier by n3storm on Wednesday March 19, 2025 @03:20AM (#43409067)

I don't see Youtube/IG/Fb/Tiktok comments as valuable content or information, I would be surprised if somebody is treasuring such content.

Maybe tweets, but APIs are available for archiving (more or less).

[ Parent | on HN ]

Re:HTTrack Website Copier by RGamma on Wednesday March 19, 2025 @03:07AM (#43409001)

monolith can work together with headless chromium. YMMV

[ Parent | on HN ]

Re:HTTrack Website Copier by superkuh on Wednesday March 19, 2025 @09:12AM (#43411467)

True. But it's more like most sites don't work anymore. They can't run without javascript and lack any content but blank pages.

[ Parent | on HN ]