News for hackers. Stuff that matters.
Re:Ask HN: Can I legally scrape my competitors website for d... by iwwr on Thursday February 03, 2011 @04:27AM (#2174210)
Any heavy scraping can be detected and blocked (or worse, corrupted), so you'd need a pool of proxies and some smart robots. You are essentially depending on your competitors to have data available and not change their website layout.

By the way, if you are using interesting scraping techniques, would you mind posting a thread or two on HN?

Re:Ask HN: Can I legally scrape my competitors website for d... by dawson on Thursday February 03, 2011 @07:38AM (#2174492)
I've used this service before http://www.80legs.com/ (for legal purposes, of course)