News for hackers. Stuff that matters.
Re:Deprecating our AJAX crawling scheme by iwilliams on Wednesday October 14, 2015 @05:18PM (#10389614)
The site is built on Tumblr which automatically generates a sitemap for the individual posts, but not any other pages on the site. For example the "about" page is not in the sitemap, but is still indexed.

There are no comments on this comment yet.