News for hackers. Stuff that matters.
Re:Breaking the 4Chan CAPTCHA by brookst on Saturday November 30, 2024 @10:35AM (#42282120)
Wouldn’t a well-intentioned bot follow robots.txt anyway?
Re:Breaking the 4Chan CAPTCHA by hamilyon2 on Sunday December 01, 2024 @10:48AM (#42288981)
Curl and libcurl doesn't. Wget doesn't, I think.
Re:Breaking the 4Chan CAPTCHA by account42 on Monday December 02, 2024 @07:29AM (#42295537)
CURL isn't a bot, it's a tool. It can be part of a bot (which may or may not respect robots.txt) but it can also just act as a user agent directly for a human operator in which case it SHOULD just do what asked. Chrome doesn't follow robots.txt either for the same reason.