News for hackers. Stuff that matters.
Re:HTTrack Website Copier by frozenice on Wednesday March 19, 2025 @02:13AM (#43408711)
Funny timing. Just yesterday I was looking for an easy Windows tool to do a simple stress-test on a website (legally ofc). A requirement of mine was to just give it the root URL and the tool should discover the rest automatically (staying on the same domain). Also, parameters like parallelism had to be easily manageable. After trying some crawlers / copiers and other tools I went back to a simple one I already knew from saving static copies of websites in the past: HTTrack. It fit the bill perfectly! You can add the root URL, set it to "scan only" (so it doesn't download everything) and tweak the settings like connections and speed (and even change some settings mid-run, save settings, pause, ...). So thanks xroche for HTTrack! :)
Re:HTTrack Website Copier by jaygray0919 on Wednesday March 19, 2025 @04:48AM (#43409565)
have used it for exactly the same purpose; have not found an equivalent tool/service - thank HTTrack
Re:HTTrack Website Copier by gtirloni on Wednesday March 19, 2025 @10:02AM (#43412145)
The issue there is that workload probably doesn't resemble your actual user requests? You could use something like k6 to script a few known use cases.
Re:HTTrack Website Copier by frozenice on Wednesday March 19, 2025 @12:46PM (#43414368)
It didn't need to in my simple case. k6 doesn't do crawling / auto-discovering, from what I can tell - I just wanted to give the tool one URL and press start.