News for hackers. Stuff that matters.
Re:An exploration of Yelp's own filtered reviews by SoftwareMaven on Sunday September 04, 2011 @07:38PM (#2960584)
That's what robots.txt is for, not silly captchas. You put captchas for the people who ignore that file.
Re:An exploration of Yelp's own filtered reviews by derwiki on Sunday September 04, 2011 @08:37PM (#2960693)
I think the idea is that given a large corpus of filtered and unfiltered reviews, you might be able to reverse engineer signals in the algorithm and game the system. If that's your end goal, you and the software you write is likely to ignore robots.txt directives.
Re:An exploration of Yelp's own filtered reviews by pud on Sunday September 04, 2011 @07:57PM (#2960615)
Not all spiders honor robots.txt