News for hackers. Stuff that matters.
Re:New modern web crawling tool by akhayam on Sunday April 30, 2023 @02:38PM (#35765345)
Sounds cool, but how is this different from Colly: https://github.com/gocolly/colly?
Re:New modern web crawling tool by XORbit01 on Sunday May 07, 2023 @07:34PM (#35856619)
colly have 103 contribs webpalm have 1 and only sigma contrib
Re:New modern web crawling tool by XORbit01 on Sunday April 30, 2023 @02:01PM (#35764980)
webpalm is a command-line tool that traverses a website and generates a tree of all the webpages and their links, additionally it can dump data from the body of the pages using regular expressions then store the result in a file.
Re:New modern web crawling tool by DavidNielsen on Sunday April 30, 2023 @03:20PM (#35765751)
Something proudly declaring itself powered by Malwarize, that sounds comforting.