Re:How to Crawl the Web with Scrapy
by matheusmoreira on Monday September 13, 2021 @03:51PM
(#28515936)
Yeah. I hate cloudflare, captchas. Why can't these companies accept that our scrapers are valid user agents? Only Google is allowed to do it, nobody else.
[ Parent
| on HN ]