Re:Who exactly is crawling my site?
by guard-of-terra on Friday October 18, 2013 @05:47PM
(#6574235)
Do you/did you receive traffic from DDG? Because DDG uses Yandex for [some] organic search results and if you block its spider you will also partially block DDG.
[ Parent
| on HN ]