News for hackers. Stuff that matters.
Re:Preventing Site Scraping by epoxyhockey on Thursday May 17, 2012 @05:28PM (#3989199)
I love the first comment on that post: It will be more of a pain than usual, but I will get the data. I always get the data.

- As mentioned: AJAXification the data makes it easier to grab.

- Convert text to images? I'll OCR it. http://code.google.com/p/tesseract-ocr/wiki/ReadMe

- Honeypot a random link? I don't scrape every link on the page, only links that have my data.

- Randomize the output? And drive your real users crazy?

I have found that the best deterrent to drive-by scraping is to not put CSS id's on everything. Apart from that, you'll need to put the data behind a pay wall.

There are no comments on this comment yet.