News for hackers. Stuff that matters.
Re:Unix swiss army knife for headless browser JavaScript by tracker1 on Sunday April 19, 2015 @10:36PM (#9405847)
It's worth noting, that googlebot does seem to do page renders with JS, though not as frequently and usually several days behind a non-js detected change. Bingbot definitely does, and this can even be seen in google analytics oddly enough (google doesn't seem to do any filtering for non-browser rendering).

Came to a lot of this knowledge when changing a url structure for a few hundred thousand pages (with permanent redirects in place)... the bing bot results on analytics were really surprising, and had to adjust filtering.

Re:Unix swiss army knife for headless browser JavaScript by MichaelGG on Sunday April 19, 2015 @10:51PM (#9405884)
Interesting; I should play with it. I got the impression they "sorta" do JS, but wouldn't run a bunch of XHR and so on