News for hackers. Stuff that matters.
Re:Ask HN: What's your philosophy on page scraping? by nostrademons on Friday March 26, 2010 @06:12AM (#1220659)
I'm happy to page scrape other sites and not happy to have mine scraped. ;-)

More seriously, if there're bots that you don't want scraping, just robots.txt them away. If they ignore that, then they're being rather rude and you can figure out some way to auto-block them.

There are no comments on this comment yet.