Re:New modern web crawling tool
by XORbit01 on Sunday April 30, 2023 @02:01PM
(#35764980)
webpalm is a command-line tool that traverses a website and generates a tree of all the webpages and their links, additionally it can dump data from the body of the pages using regular expressions then store the result in a file.
[ Parent
| on HN ]
There are no comments on this comment yet.