Re:What one may find in robots.txt
by malka on Monday May 18, 2015 @07:01AM
(#9563700)
with bots ? If an Ip does not respect the host rules, it deserves to be blocked.
[ Parent
| on HN ]
For a start, the entire nation of Qatar shares 82.148.97.69.
And it's definitely not a good idea to run a bot from there.
That's actually not true. A bunch of people in Qatar use that IP though.