Re:Google will punish sites that use annoying pop-up ads
by falcor84 on Sunday September 10, 2017 @02:31PM
(#15213521)
>scrape my site without permission.
No one needs permission to request a web page, and that includes bots. But if that still bothers you, why not create arobots.txt with your preferences?
No one needs permission to request a web page, and that includes bots. But if that still bothers you, why not create arobots.txt with your preferences?