News for hackers. Stuff that matters.
Re:“Google is wrapping knowledge up in answer cards and not ... by walterbell on Monday October 20, 2014 @06:54PM (#8484992)
Is there a generic list of defense techniques against scrapers, including but not limited to Google? E.g. move some content behind a login wall?
Re:“Google is wrapping knowledge up in answer cards and not ... by landtco on Monday October 20, 2014 @06:56PM (#8484998)
In theory, you can disallow crawlers and bots via robots.txt. It's not a hard defense per se because crawlers can ignore it.