News for hackers. Stuff that matters.
Re:The AI bullshit singularity by Turing_Machine on Sunday February 18, 2024 @03:40PM (#39423021)
I guess some of it might depend on how good the AI-generated content gets, and also how good the AI gets at detecting AI-generated content.

If the AI was good at detecting it, it wouldn't matter if the AI-generated content sucked, yes?

Even a low probability of detection would help. Let's say our algorithm is 50% likely to detect AI junk. That means that half the junk data won't make it in to model. Even 20% would probably be worthwhile, especially if it also threw away human-generated junk (and let's be realistic here: there is, and always has been, no shortage of terrible and/or wrong human-generated content).

Let's say those crappy filler paragraphs that get stuck between pictures on meme clickbait pages... I suspect most of those people have already been replaced, but that prose was horrible long before the current LLM boom.

I suspect there is a lot of effort being expended right now on ways to ensure the training data (whether human or AI generated) isn't shite.

Re:The AI bullshit singularity by vrighter on Monday February 19, 2024 @01:49AM (#39426841)
ai detectors can be used to train ais to avoid triggering them. It's a race that cannot be won. ai detection can't, and already doesn't, work.
Re:The AI bullshit singularity by Turing_Machine on Monday February 19, 2024 @10:37AM (#39430912)
> ai detection can't, and already doesn't, work.

Then how can humans often tell that something is generated by AI?

Besides, I wasn't suggesting AI detection as such. I was suggesting crap detection, regardless of how the crap was produced.

You probably don't want crappy human-generated content going into your training set, either.

Re:The AI bullshit singularity by asadotzler on Monday February 19, 2024 @07:19PM (#39436510)
Humans are smarter than machines. We "sense" bullshit in patterns that machines cannot yet intuit. I can tell when something's AI generated. It has a smell or a flavor that's different from human work and it's a variable pattern because, like a southern accent, I can tell if it's Georgia or Alabama, Gemini or Claud, even if very capable machines cannot.