News for hackers. Stuff that matters.
Re:Ask HN: How are you dealing with scraping hits from EC2 m... by dumbfounder on Wednesday December 12, 2012 @09:24AM (#4910133)
Calling them "scrapers" implies they are doing something nefarious (stealing content). Robots.txt is for law abiding bots.
Re:Ask HN: How are you dealing with scraping hits from EC2 m... by ig1 on Wednesday December 12, 2012 @09:43AM (#4910232)
Not really. "Scraping" just refers to extracting data from a site using an automated method, it doesn't have any connotations about the motivation or acceptability of the process.