News for hackers. Stuff that matters.

A comment on Twitter just updated its robots.txt to exclude all scrapers. Parent comment

Re:Twitter just updated its robots.txt to exclude all scrapers by searchmartin on Thursday July 16, 2015 @03:13PM (#9899301)
again, no, they blocked it on WWW. only: http://webmarketingschool.com/no-twitter-did-not-just-de-ind...
[ Parent | on HN ]

There are no comments on this comment yet.