Re:Ask HN: What are the things that you have automated in yo...
by monksy on Monday June 25, 2018 @10:57AM
(#17392879)
How has your experience been with their anti-scraping attempts?
[ Parent
| on HN ]
Re:Ask HN: What are the things that you have automated in yo...
by avshyz on Monday July 02, 2018 @02:35PM
(#17444273)
Certain requests returned errors unless I've fetched them in the browser's context (pretty easy using using puppeteer).
I've also been throttled.
My password was reset after an aggressive scrape and I was prompted with a mail stating my account's behaviour's suspicious.
The solution was, obviously, to make my scraper run slower. :)