News for hackers. Stuff that matters.
Re:Who exactly is crawling my site? by pavel_lishin on Friday October 18, 2013 @07:17PM (#6574584)
Presumably you could set a minimum interval - an hour, or a day. This would make sure that big updates are noticed, without putting undue stress on the server.

There are no comments on this comment yet.