News for hackers. Stuff that matters.
Re:AI models collapse when trained on recursively generated ... by throwup238 on Wednesday July 24, 2024 @01:15PM (#41059346)
It’s an analogy. The learning materials teachers create for students is very much like synthetic data, it’s just not assembled from algorithmic output.
Re:AI models collapse when trained on recursively generated ... by lanstin on Wednesday July 24, 2024 @01:28PM (#41059502)
kids learn, walking talking reading arithmetic and physics, by doing things in the physical world. Adults may speak differently to kids than adults, but it's a stretch to say it's synthetic. Equivalent to synthetic would be a group of kids that just grew up together and made up a novel language.
Re:AI models collapse when trained on recursively generated ... by Demonoculus on Thursday July 25, 2024 @05:12AM (#41066512)
granted synthetic is closely related to synthesis, but in common parlance synthetic would mean something that is not natural or abiotic in some sense, in case of synthetic data, it should imply data that doesn't occur naturally from human and natural sources. i.e. synthetic data would be exactly the one that is assembled from algorithmic output. granted im not able to explain it as well as i understand it.