News for hackers. Stuff that matters.
Re:Show HN: Crawlee – Web scraping and browser automation li... by bobajeff on Tuesday August 23, 2022 @07:40AM (#32563337)
It would be very useful if this or some other library came with Captcha solvers or a way to add Captcha solvers to the scrapers. Even regular users get Captchas sometimes.
Re:Show HN: Crawlee – Web scraping and browser automation li... by mnmkng on Tuesday August 23, 2022 @08:06AM (#32563597)
You can use any captcha solving service with Crawlee, but we plan to add a plugin to make its use much easier. It's on our roadmap.
Re:Show HN: Crawlee – Web scraping and browser automation li... by willmorrison on Tuesday August 23, 2022 @07:55AM (#32563491)
It looks like you can specify HTTP headers, so you should be able to use a captcha solving service with Crawlee.
Re:Show HN: Crawlee – Web scraping and browser automation li... by mnmkng on Tuesday August 23, 2022 @08:07AM (#32563602)
word!