News for hackers. Stuff that matters.
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by alex-moon on Saturday May 31, 2025 @05:19AM (#44143043)
The wall is training data. An AI can't produce its own training data because an AI can't be smarter than its own training data. This is a well known regression problem and one I personally believe is not solvable. (A softer assertion would be: it's not solvable with current technology.)
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by rxtexit on Sunday June 01, 2025 @07:44AM (#44150184)
I use to think this but no one I have read believes data is the problem.

Amodei explains that if data, model size and compute scale up linearly, then the reaction happens.

I don't understand why data wouldn't be a problem but it seems like if it was, we would have ran into this problem already and it has already been overcome with synthetic data.