News for hackers. Stuff that matters.
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by deadbabe on Friday May 30, 2025 @11:50AM (#44137425)
Better at what
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by hollerith on Friday May 30, 2025 @12:07PM (#44137589)
Better at avoiding human oversight and better at achieving whatever meaningless goal (or optimization target) was unintentionally given to it by the lab that created it.
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by deadbabe on Friday May 30, 2025 @12:11PM (#44137635)
So better at nothing that actually matters.
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by hollerith on Friday May 30, 2025 @12:24PM (#44137752)
I disagree.

I expect AI to make people's lives better (probably much better) but then an AI model will be created that undergoes a profound increase in cognitive capabilities, then we all die or something else terrible happens because no one knows how to retain control over an AI that is much more all-around capable than people are.

Maybe the process by which it undergoes the profound capability increase is to "improve itself by rewriting its own code", as described in the OP.

Re:The Darwin Gödel Machine: AI that improves itself by rewr... by deadbabe on Friday May 30, 2025 @12:43PM (#44137923)
Just stop using it.
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by GolfPopper on Friday May 30, 2025 @12:05PM (#44137572)
Paperclip maximization.