News for hackers. Stuff that matters.

A comment on Twitter just updated its robots.txt to exclude all scrapers. Parent comment

Re:Twitter just updated its robots.txt to exclude all scrapers by sp332 on Friday July 17, 2015 @11:49AM (#9903301)
(Update: the Wayback Machine will be fine, using the twitter.com/robots.txt)
[ Parent | on HN ]

There are no comments on this comment yet.