Re:Ask HN: How do you guys stop scrapers from mirroring your...
by gexla on Sunday January 16, 2011 @12:36AM
(#2108780)
This is basically cloaking (showing your content one way to regular readers and showing it a different way to search engines,) which could get you slapped by Google. Not worth this risk IMO. However, maybe there is a way to do this so you don't have to cloak? Not sure, I have never looked into it.
[ Parent
| on HN ]
Re:Ask HN: How do you guys stop scrapers from mirroring your...
by evgen on Sunday January 16, 2011 @12:56AM
(#2108801)
Just support Google's AJAX crawling standards and disallow the escaped_fragment requests from crawlers that are not on your whitelist.