Show HN: Webclone.js – A simple tool to clone websites

Posted by jadesee on Tuesday December 02, 2025 @12:32AM
from the show-hn dept.

I needed a lightweight way to archive documentation from a website. wget and similar tools failed to clone the site reliably (missing assets, broken links, etc.), so I ended up building a full website-cloning tool using Node.js + Puppeteer.

Repo: https://github.com/jademsee/webclone

Feedback, issues, and PRs are very welcome.

( 11 comments | 4 points | on HN )

Re:Show HN: Webclone.js – A simple tool to clone websites by khiqinsta on Tuesday December 02, 2025 @10:01AM (#46121881)

can it also clone games? you know these web html games

[ Parent | on HN ]

Re:Show HN: Webclone.js – A simple tool to clone websites by jadesee on Tuesday December 02, 2025 @01:27PM (#46124547)

I haven't tried. Would you be able to share some links so I could test?

[ Parent | on HN ]

Re:Show HN: Webclone.js – A simple tool to clone websites by moralestapia on Tuesday December 02, 2025 @10:06AM (#46121940)

Hey thanks! This is quite handful, I often do this "manually", lol.

[ Parent | on HN ]

Re:Show HN: Webclone.js – A simple tool to clone websites by jadesee on Tuesday December 02, 2025 @01:29PM (#46124586)

Glad you find it useful. Please feel free to share with your friends.

[ Parent | on HN ]

Re:Show HN: Webclone.js – A simple tool to clone websites by ohans on Tuesday December 02, 2025 @10:15AM (#46122026)

Looks good! You could push to npm so that running it could be as easy as:

npx webclone URL (no repo cloning required)

Also, FYI, when running the example code

node webclone.js https://www.example.com/

It fails (at least for me) until I either install yt-dlp or ignore videos via:

node webclone.js https://www.example.com/

[ Parent | on HN ]

Re:Show HN: Webclone.js – A simple tool to clone websites by jadesee on Tuesday December 02, 2025 @01:25PM (#46124512)

Great feedback! Will get this fixed. Thank you.

[ Parent | on HN ]

Re:Show HN: Webclone.js – A simple tool to clone websites by ohans on Tuesday December 09, 2025 @04:24AM (#46202981)

No qualms! Thanks for sharing :)

[ Parent | on HN ]

Re:Show HN: Webclone.js – A simple tool to clone websites by jadesee on Thursday December 04, 2025 @09:21AM (#46147946)

Hello. I have tested this and it indeed looks for yt-dlp at the beginning even though the site is not a video platform. I have logged the issue on GitHub and working on a fix. Thank you for the feedback!

[ Parent | on HN ]

Re:Show HN: Webclone.js – A simple tool to clone websites by frankhsu on Tuesday December 02, 2025 @10:18PM (#46129905)

Really nice tool, Thank you! I had confronted some issues after cloned the repo and installed the node_modules. I'm using node.js v20, when I tried "node webclone.js --help" the terminal catch a error of "Error [ERR_REQUIRE_ESM]: require() of ES Module /Users/fangyexu/Desktop/dev-s/_github/webclone/node_modules/yargs/index.mjs not supported."

Then I just throwed it to my Cursor and it help me solved the issue.

[ Parent | on HN ]

Re:Show HN: Webclone.js – A simple tool to clone websites by jadesee on Thursday December 04, 2025 @09:22AM (#46147956)

Thank you for the feedback. I will check it out.

[ Parent | on HN ]

Re:Show HN: Webclone.js – A simple tool to clone websites by jadesee on Thursday December 04, 2025 @09:24AM (#46147970)

By the way, would it be possible to share how the issue was resolved on your end?

[ Parent | on HN ]