Re:Wikimedia is moving to Gitlab
by detaro on Wednesday October 28, 2020 @12:28PM
(#24920719)
It doesn't stop the spam from being created, but it does stop the spam from ruining your site reputation in search results was the suggestion I guess.
[ Parent
| on HN ]
But the goal is to prevent spam in the first place. I don't think these bots will verify robots.txt to see if the spamming is effective. They just spam anything they can get their hands on.
They probably don't have general code that spam any form, it's more likely that they have code specific to GitLab CE instances that knows to post snippets. If GitLab changes their default configuration so that those snippets are no longer indexed by Google, the spammer are likely to stop using that GitLab CE spamming script, after a while.