News for hackers. Stuff that matters.
Re:How Googlebot crawls JavaScript by Loic on Tuesday May 12, 2015 @07:53AM (#9531004)
For people wondering about Ajax requests, Googlebot is performing them very well together with SVG rendering.

For example this URL:

https://www.chemeo.com/predict?smiles=CCCC

is performing the drawing of the molecule using RaphaelJS, then pulling the corresponding molecule from the database using Ajax and updating the page. Googlebot is performing all the steps perfectly well to add the end index the page.

It is very annoying because this is not important in our case, what we want is the good indexing of the main data pages, not these pages... I do not want to block the bot yet, but I need to figure out a way to have the main page better ranked.

Re:How Googlebot crawls JavaScript by gildas on Tuesday May 12, 2015 @08:03AM (#9531065)
However, if you search on Google:

    "Property Prediction for Butane" site:https://www.chemeo.com
You'll see this page is not indexed.
Re:How Googlebot crawls JavaScript by Loic on Tuesday May 12, 2015 @08:42AM (#9531271)
Interesting, it looks like they massively dropped these pages from the index (or at least, from what they return as results) this is great (if they are not dropping other important pages)!
Re:How Googlebot crawls JavaScript by kyle6884 on Tuesday May 12, 2015 @01:49PM (#9533550)
you could add an additional URL parameter via pushState and ensure that you're defining the canonical tag only to the main data pages. You could also define the new parameter in webmaster tools and tell googlebot to ignore it