News for hackers. Stuff that matters.
Re:Who exactly is crawling my site? by guard-of-terra on Friday October 18, 2013 @05:47PM (#6574235)
Do you/did you receive traffic from DDG? Because DDG uses Yandex for [some] organic search results and if you block its spider you will also partially block DDG.
Re:Who exactly is crawling my site? by nostromo on Friday October 18, 2013 @07:07PM (#6574547)
I did not know that! Thanks, I'll look.