Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Avoiding bot detection: How to scrape the web without getting blocked?. Parent comment
I don't know about $10m/year, but many sites block bots just because they don't want competitors to access publicly available data. Which is bullshit.
There are no comments on this comment yet.
I don't know about $10m/year, but many sites block bots just because they don't want competitors to access publicly available data. Which is bullshit.