News for hackers. Stuff that matters.
Re:Ask HN: Best way to block an EC2-hosted scraper? by getsat on Sunday January 09, 2011 @01:54PM (#2086054)
If you're feeling nefarious, 301 their requests to a static, empty RSS feed.

If you can figure out who's actually running it (does the user agent say?), simply sending them an email and asking them to throttle their script may be the simplest solution.

Re:Ask HN: Best way to block an EC2-hosted scraper? by brandnewlow on Sunday January 09, 2011 @01:57PM (#2086071)
Agent doesn't say unfortunately.
Re:Ask HN: Best way to block an EC2-hosted scraper? by joewest on Sunday January 09, 2011 @02:04PM (#2086087)
You should report the behavior to Amazon:

http://aws-portal.amazon.com/gp/aws/html-forms-controller/co...

In my experience they take it seriously and deal with it promptly.