News for hackers. Stuff that matters.
Re:Google, please don't close the web by farmdawgnation on Friday March 09, 2012 @11:23PM (#3687032)
Did you try changing your user agent? I work for a company that runs a heavily javascripted site, and we return straight HTML if you are a bot. It's entirely possible that they do the same...
Re:Google, please don't close the web by FireBeyond on Friday March 09, 2012 @11:26PM (#3687041)
They shouldn't. At least if they follow their own rules. They cracked down heavily on sites (like experts-exchange.com) who would display results and answers to GoogleBot, but when humans attempted to browse that page, they had to register/ pay to see the same page.
Re:Google, please don't close the web by Achshar on Friday March 09, 2012 @11:28PM (#3687044)
That's known as cloaking. user agent sniffing is never a very good idea from SEO perspective. googlebot also uses normal browser user agent and if it finds that you are returning different content based on user agent then your site can be in trouble.