News for hackers. Stuff that matters.
Re:GPT-5 by runako on Thursday August 07, 2025 @03:33PM (#44829292)
> presumably LLM output is going into the training data of later LLMs

The LLM vendors go to great lengths to assure their paying customers that this will not be the case. Yes, LLMs will ingest more LLM-generated slop from the public Internet. But as businesses integrate LLMs, a rising percentage of their outputs will not be included in training sets.

Re:GPT-5 by mikepurvis on Thursday August 07, 2025 @03:54PM (#44829557)
The LLM vendors aren't exactly the most trustworthy on this, but regardless of that, there's still lots of free-tier users who are definitely contributing back into the next generation of models.
Re:GPT-5 by runako on Thursday August 07, 2025 @04:35PM (#44829995)
For sure, although I'm fairly certain there is a difference in kind between the outputs of free and paid users (and then again to API usage).
Re:GPT-5 by scottLobster on Thursday August 07, 2025 @04:07PM (#44829711)
Please describe these "great lengths". They allowing customer audits now?

The first law of Silicon Valley is "Fake it till you make it", with the vast majority never making it past the "Fake it" stage. Whatever the truth may be, it's a safe bet that what they've said verbally is a lie that will likely have little consequence even if exposed.

Re:GPT-5 by runako on Thursday August 07, 2025 @04:33PM (#44829982)
> great lengths to assure

is not incompatible with

> "Fake it till you make it"

I don't know where they land, but they are definitely telling people they are not using their outputs to train. If they are, it's not clear how big of a scandal would result. I personally think it would be bad, but I clearly overindex on privacy & thought the news of ChatGPT chats being indexed by Google would be a bigger scandal.

Re:GPT-5 by fragmede on Thursday August 07, 2025 @05:21PM (#44830525)
You did hear that it did happen (however briefly) though, yeah?

https://techcrunch.com/2025/07/31/your-public-chatgpt-querie...

Re:GPT-5 by runako on Thursday August 07, 2025 @06:16PM (#44831060)
That's my point. It is a thing that is known and obviously a big negative, but yet failed to leave a lasting mark of any kind.
Re:GPT-5 by KoolKat23 on Thursday August 07, 2025 @04:37PM (#44830024)
That's only if you opt out.
Re:GPT-5 by runako on Thursday August 07, 2025 @06:23PM (#44831131)
ChatGPT training is (advertised as) off by default for their plans above the prosumer level, Team & Enterprise. API results are similarly advertised as not being used for training by default.

Anthropic policies are more restrictive, saying they do not use customer data for training.

Re:GPT-5 by RhysU on Thursday August 07, 2025 @06:06PM (#44830958)
Ah, the eternal internal corporate search problem.