Re:BotOrNot (2021)
by mateuszbuda on Friday September 15, 2023 @06:10PM
(#37529710)
Some parts are outdated now. Bot detection vs web scraping is an ever evolving arms race.
Anyway, incolumnitas blog is a great source of information about bot detection and techniques to avoid being detected. We have implemented many successful methods based on it in https://scrapingfish.com/.
Anyway, incolumnitas blog is a great source of information about bot detection and techniques to avoid being detected. We have implemented many successful methods based on it in https://scrapingfish.com/.