Re:Full Text RSS Feed: Get the whole feed and nothing but th...
by roll on Tuesday March 01, 2011 @06:46PM
(#2277799)
interesting project. I was doing a similar thing with yahoo pipes, but it got blocked because of robots.txt.
What do you do about it?
[ Parent
| on HN ]
Re:Full Text RSS Feed: Get the whole feed and nothing but th...
by shadowpwner on Tuesday March 01, 2011 @07:31PM
(#2277944)
You can always disregard robots.txt.. ;)