News for hackers. Stuff that matters.
Re:What's Going on at Google? Massive Search Engine Spam Attack by bhartzer on Friday December 22, 2023 @04:44PM (#38739027)
That 'policy' is still actually in effect, I believe, in Google's webmaster guidelines. They just don't enforce it.

Years ago (early 2000s) Google used to mostly crawl using Google-owned IPs, but they'd occasionally use Comcast or some other ISPs (partners) to crawl. If you were IP cloaking, you'd have to look out for those pesky non-Google IPs. I know, as I used to play that IP cloaking game back in the early 2000s, mostly using scripts from a service called "IP Delivery".

Re:What's Going on at Google? Massive Search Engine Spam Attack by LoulouMonkey on Friday December 22, 2023 @06:37PM (#38739976)
Not sure about now, but I worked in the T&S Webspam team (in Dublin, Ireland) until 2021, and we were very much enforcing cloaking.

It was, however, one of the most difficult types of spam to detect and penalise, at scale.

Re:What's Going on at Google? Massive Search Engine Spam Attack by amluto on Friday December 22, 2023 @07:27PM (#38740437)
Is it even well defined? On the one hand, there’s “cloaking,” which is forbidden. On the other hand, there’s “gating,” which is allowed, and seems to frequency consist of showing all manner of spammy stuff and requests for personal information in lieu of the indexed content. Are these really clearly different?

And then there’s whatever Pinterest does, which seems awfully like cloaking or bait-and-switch or something: you get a high ranked image search result, you click it, and the page you see is in no way relevant to the search or related to the image thumbnail you clicked.

Re:What's Going on at Google? Massive Search Engine Spam Attack by bombcar on Friday December 22, 2023 @07:33PM (#38740472)
Whatever Pinterest does should result in them being yeeted from all search engines, tbh.
Re:What's Going on at Google? Massive Search Engine Spam Attack by mrwiseowl on Friday December 22, 2023 @10:18PM (#38741319)
Do you have any example searches for the Pinterest results you're describing? I feel like I know what you're talking about but wondering what searches return this.
Re:What's Going on at Google? Massive Search Engine Spam Attack by yreg on Saturday December 23, 2023 @04:58AM (#38743000)
I think they must be penalized, because I see this a lot less in the results than I used to.

And byw (unless we are talking about different things) it was possible to get to the image on target page, but it was walled off behind a log in.

Re:What's Going on at Google? Massive Search Engine Spam Attack by LoulouMonkey on Saturday December 23, 2023 @07:54AM (#38743901)
Apologies for not responding quicker.

For context, my team wrote scripts to automate catching spam at scale.

Long story short, there are non spam-related reasons why one would want to have their website show different content to their users and to a bot. Say, adult content in countries where adult content is illegal. Or political views, in a similar context.

For this reason, most automated actions aren't built upon a single potential spam signal. I don't want to give too much detail, but here's a totally fictitious example for you:

* Having a website associated with keywords like "cheap" or "flash sale" isn't bad per say. But that might be seen as a first red flag

* Now having those aforementioned keywords, plus "Cartier" or "Vuitton" would be another red flag

* Add to this the fact that we see that this website changed owners recently, and used to SERP for different keywords, and that's another flag

=> 3 red flags, that's enough for some automation rule to me.

Again, this is a totally fictitious example, and in reality things are much more complex than this (plus I don't even think I understood or was exposed to all the ins and outs of spam detection while working there).

But cloaking on its own is kind of a risky space, as you'd get way too many false positives.

Re:What's Going on at Google? Massive Search Engine Spam Attack by mrwiseowl on Friday December 22, 2023 @06:52PM (#38740148)
Curious. How is it detected in the first place if not reported like in this case?
Re:What's Going on at Google? Massive Search Engine Spam Attack by jiveturkey on Saturday December 23, 2023 @01:09AM (#38742051)
sampling from non-bot-IPs and non-bot UAs
Re:What's Going on at Google? Massive Search Engine Spam Attack by bhartzer on Friday December 22, 2023 @04:49PM (#38739074)
You can actually get a manual action (penalty) from Google if you do IP cloaking/redirects. It's still mentioned prominently in Google's Webmaster Guidelines: https://support.google.com/webmasters/answer/9044175?hl=en#z...
Re:What's Going on at Google? Massive Search Engine Spam Attack by franze on Friday December 22, 2023 @07:21PM (#38740373)
And then there is Dynamic Rendering which OKed cloaking

https://developers.google.com/search/docs/crawling-indexing/...

and the there are AMP pages which is Google Enforced cloaking...

Re:What's Going on at Google? Massive Search Engine Spam Attack by londons_explore on Friday December 22, 2023 @11:27PM (#38741629)
I think by now all search engines run JavaScript and index the rendered page...
Re:What's Going on at Google? Massive Search Engine Spam Attack by gildas on Saturday December 23, 2023 @06:11AM (#38743333)
As the founder of SEO4Ajax, I can assure you that this is far from the case. Googlebot, for example, still has great difficulty indexing dynamically generated JavaScript content on the client side.
Re:What's Going on at Google? Massive Search Engine Spam Attack by charrondev on Saturday December 23, 2023 @11:19AM (#38745345)
This isn’t about JavaScript vs no JavaScript.

It’s about serving different pages based on User Agent.