News for hackers. Stuff that matters.
Re:Announcing GPT-NeoX-20B by dash2 on Wednesday February 02, 2022 @01:32PM (#30181785)
Does anyone know whether the spammy websites that sit at the top of search engine results are already generated by this kind of model?
Re:Announcing GPT-NeoX-20B by ChefboyOG on Wednesday February 02, 2022 @02:23PM (#30182648)
By and large, no.

That's not to say that those sites are not generated programmatically--without a doubt, most of them are--but not by a cutting edge transformer model. The fact is, generating words has never been the bottleneck for blackhat SEO types. Generally, those sites are generating their content through some kind of scraping, or in rarer cases, paying pennies for nonsense articles. The page itself is structured for search (targeted H1s, metadata, etc.) and some kind of private blog network is used to create a pyramid of backlinks.

Re:Announcing GPT-NeoX-20B by daniel-cussen on Wednesday February 02, 2022 @07:53PM (#30186828)
The fact of generating words programmatically is hard to mask. You end up with all kinds of computational biases humans don't have.
Re:Announcing GPT-NeoX-20B by nefitty on Wednesday February 02, 2022 @02:02PM (#30182276)
That's a use case. I don't see why anyone would go out of their way to make intelligible content for spam. Google is so broken right now that SEO hacks are easy to generate. Not to overstress the tangent, but without search operstors, I have to sift through pointless Gitlab/Github/Stackoverflow/Wikipedia clones all the time.