Re:The Darwin Gödel Machine: AI that improves itself by rewr...
by alex-moon on Saturday May 31, 2025 @05:19AM
(#44143043)
The wall is training data. An AI can't produce its own training data because an AI can't be smarter than its own training data. This is a well known regression problem and one I personally believe is not solvable. (A softer assertion would be: it's not solvable with current technology.)
[ Parent
| on HN ]
Re:The Darwin Gödel Machine: AI that improves itself by rewr...
by rxtexit on Sunday June 01, 2025 @07:44AM
(#44150184)
I use to think this but no one I have read believes data is the problem.
Amodei explains that if data, model size and compute scale up linearly, then the reaction happens.
I don't understand why data wouldn't be a problem but it seems like if it was, we would have ran into this problem already and it has already been overcome with synthetic data.