AI models collapse when trained on recursively generated data

Re:AI models collapse when trained on recursively generated ... by astrange on Wednesday July 24, 2024 @07:10PM (#41063168)

They can't directly train on chat transcripts, because they contain private information and other things you don't want appearing in answers. I doubt they even look at them unless you press the thumbs down, in which case they probably use it in some indirect way.

They might try to look for trends or what questions are popular of course.

[ Parent | on HN ]

Re:AI models collapse when trained on recursively generated ... by ipaddr on Wednesday July 24, 2024 @10:35PM (#41064253)

That's exactly what they are doing and what you agreed to ans why some use other models or running something locally.

[ Parent | on HN ]

Re:AI models collapse when trained on recursively generated ... by fantasybuilder on Wednesday July 24, 2024 @11:25PM (#41064450)

Haha, exactly. I switched to local Llama 3 and never looked back.

[ Parent | on HN ]

Re:AI models collapse when trained on recursively generated ... by astrange on Thursday July 25, 2024 @04:00PM (#41072733)

If they were training on other people's chat transcripts, the answers would read like how other people type, instead of telling you to delve mystically into intriguing questions.

[ Parent | on HN ]

Re:AI models collapse when trained on recursively generated ... by ipaddr on Thursday July 25, 2024 @05:12PM (#41073449)

https://help.openai.com/en/articles/5722486-how-your-data-is...

Updated a week ago:

ChatGPT, for instance, improves by further training on the conversations people have with it, unless you opt out.

[ Parent | on HN ]

Re:AI models collapse when trained on recursively generated ... by astrange on Friday July 26, 2024 @01:45PM (#41080601)

Easier to write that than explain their internal processes. But what would be the point? Training on someone asking a question doesn't cause it to learn the correct answer.

[ Parent | on HN ]