Re:The Darwin Gödel Machine: AI that improves itself by rewr...
by hollerith on Friday May 30, 2025 @12:07PM
(#44137589)
Better at avoiding human oversight and better at achieving whatever meaningless goal (or optimization target) was unintentionally given to it by the lab that created it.
[ Parent
| on HN ]
Re:The Darwin Gödel Machine: AI that improves itself by rewr...
by deadbabe on Friday May 30, 2025 @12:11PM
(#44137635)
So better at nothing that actually matters.
Re:The Darwin Gödel Machine: AI that improves itself by rewr...
by hollerith on Friday May 30, 2025 @12:24PM
(#44137752)
I disagree.
I expect AI to make people's lives better (probably much better) but then an AI model will be created that undergoes a profound increase in cognitive capabilities, then we all die or something else terrible happens because no one knows how to retain control over an AI that is much more all-around capable than people are.
Maybe the process by which it undergoes the profound capability increase is to "improve itself by rewriting its own code", as described in the OP.