AI models collapse when trained on recursively generated data

Re:AI models collapse when trained on recursively generated ... by ipaddr on Wednesday July 24, 2024 @10:35PM (#41064253)

That's exactly what they are doing and what you agreed to ans why some use other models or running something locally.

[ Parent | on HN ]

Re:AI models collapse when trained on recursively generated ... by fantasybuilder on Wednesday July 24, 2024 @11:25PM (#41064450)

Haha, exactly. I switched to local Llama 3 and never looked back.

[ Parent | on HN ]

Re:AI models collapse when trained on recursively generated ... by astrange on Thursday July 25, 2024 @04:00PM (#41072733)

If they were training on other people's chat transcripts, the answers would read like how other people type, instead of telling you to delve mystically into intriguing questions.

[ Parent | on HN ]

Re:AI models collapse when trained on recursively generated ... by ipaddr on Thursday July 25, 2024 @05:12PM (#41073449)

https://help.openai.com/en/articles/5722486-how-your-data-is...

Updated a week ago:

ChatGPT, for instance, improves by further training on the conversations people have with it, unless you opt out.

[ Parent | on HN ]

Re:AI models collapse when trained on recursively generated ... by astrange on Friday July 26, 2024 @01:45PM (#41080601)

Easier to write that than explain their internal processes. But what would be the point? Training on someone asking a question doesn't cause it to learn the correct answer.

[ Parent | on HN ]