News for hackers. Stuff that matters.
Re:Ask HN: When to give up? by resu on Friday November 22, 2013 @10:26AM (#6781213)
Will my site not be penalized if the crawler thinks everything on it points to crawlspa.com?
Re:Ask HN: When to give up? by ds_ on Friday November 22, 2013 @10:28AM (#6781235)
It shouldn't, because the crawler should only see your server (your server stands in front of crawlspa as a proxy). If you don't have access to your server config and redirect in the code, then it's possible.