Re:Ask HN: Best way to block an EC2-hosted scraper?
by brandnewlow on Sunday January 09, 2011 @01:57PM
(#2086071)
Agent doesn't say unfortunately.
Re:Ask HN: Best way to block an EC2-hosted scraper?
by joewest on Sunday January 09, 2011 @02:04PM
(#2086087)
You should report the behavior to Amazon:
http://aws-portal.amazon.com/gp/aws/html-forms-controller/co...
In my experience they take it seriously and deal with it promptly.
If you can figure out who's actually running it (does the user agent say?), simply sending them an email and asking them to throttle their script may be the simplest solution.