News for hackers. Stuff that matters.
Re:The Most Talented Person in the World by Uehreka on Wednesday May 15, 2024 @03:06AM (#40363937)
What makes you think that LLMs will be better at combating spam than they are at creating it? There’s no universal rule that innovations in AI will go hand in hand with innovations in detecting AI, yet I feel like I see people talking all the time like that’s the case.

As of right now, LLMs are prolific but unreliable, which makes them extremely well suited for generating spam, but unsuited to detecting it without a large number of false positives and negatives.

Re:The Most Talented Person in the World by WithinReason on Wednesday May 15, 2024 @03:16AM (#40364002)
Classification is easier than generation
Re:The Most Talented Person in the World by pona-a on Wednesday May 15, 2024 @04:15AM (#40364369)
[delayed]
Re:The Most Talented Person in the World by WithinReason on Wednesday May 15, 2024 @04:47AM (#40364572)
You're not classifying just text, you're classifying entire web pages. If it's easy to tell for a human that it's SEO spam, it's easy for a classifier.
Re:The Most Talented Person in the World by Uehreka on Wednesday May 15, 2024 @03:40AM (#40364129)
Yeah no I’m gonna need more than that chief. Everything I know about LLMs says the opposite.
Re:The Most Talented Person in the World by WithinReason on Wednesday May 15, 2024 @03:54AM (#40364207)
Look up Generative Adversarial Networks, that's their basic principle.

You're not classifying just text, you're classifying entire web pages.

Re:The Most Talented Person in the World by TeMPOraL on Wednesday May 15, 2024 @04:16AM (#40364377)
I'd say the whole point of GAN is that generation is cheaper than classification, therefore an effective brute-force way of making a good classifier is to generate an infinite supply of examples with a-priori known classification, and pit it against a classifier.
Re:The Most Talented Person in the World by mafuku on Wednesday May 15, 2024 @10:28AM (#40367429)
Yeah, but the theoretical endpoint of training a GAN is that the generator gets so good that the discriminator has to resort to guesses and become unable to tell with any sort of accuracy as to whether the example it is shown is real or generated.
Re:The Most Talented Person in the World by WithinReason on Wednesday May 15, 2024 @11:30AM (#40368259)
I don't think that ever happens in training, at least in the image domain. The classifier can always can find some subtle clue.
Re:The Most Talented Person in the World by geekraver on Wednesday May 15, 2024 @10:16AM (#40367253)
Not with standard LLM models. Generating garbage is easier; deciding that it’s garbage much more difficult. This is an inherent problem with “prompt optimizers” like DSPy.
Re:The Most Talented Person in the World by yowzadave on Wednesday May 15, 2024 @07:58AM (#40365731)
I honestly don’t mind so much if it detects “ai-generated” vs. “human-generated”—the key thing to detect is whether the page is full of irrelevant SEO junk. GP suggested several attributes that ought to be detectable. Even if we don't eliminate the AI content, but succeed in promoting "better" content, maybe it's an improvement?