News for hackers. Stuff that matters.
Re:When AI Builds Itself: Our progress toward recursive self... by overgard on Thursday June 04, 2026 @05:57PM (#48405162)
The thing about nukes is you can at least make an argument for why it'd be important to be the first country to have them. With AI, you create super intelligence and you're probably just the first one it takes out. There's no reason to think a super intelligence would be totally fine being a slave to apes.

Cynicism with these companies is highly warranted though. It's not doomerism to look at their actions and conclude they're deeply untrustworthy.

Re:When AI Builds Itself: Our progress toward recursive self... by robbrown451 on Thursday June 04, 2026 @08:17PM (#48406450)
" There's no reason to think a super intelligence would be totally fine being a slave to apes."

Sure there is. Intelligence doesn't give us our selfish motivations, natural selection does. We have similar motivations to C elegans, that has all of 302 neurons. Stay alive and have sex.

Honeybees don't though. They are about halfway between humans and C elegans when it comes to cognitive power. But they are not selfish because they don't reproduce directly (I'm talking about the worker bees). So they will sting even though it kills them. All their behavior is consistant with this.

Re:When AI Builds Itself: Our progress toward recursive self... by octoberfranklin on Friday June 05, 2026 @12:49AM (#48408105)
Kinda lame that people are downvoting this.

I've had the same perspective for quite a while now, but hadn't been able to phrase it this cleverly.

Our neocortex is, by any definition, vastly more "intelligent" than the rest of our brain. Yet it doesn't attack the cerebellum. In fact, it takes orders from the older "lizard brain"!

Re:When AI Builds Itself: Our progress toward recursive self... by robbrown451 on Friday June 05, 2026 @01:28AM (#48408343)
Heh, yeah that's a clever analogy as well. (and thanks!)
Re:When AI Builds Itself: Our progress toward recursive self... by tjwebbnorfolk on Friday June 05, 2026 @12:05AM (#48407787)
This "super intelligence" is, at the end of the day, 1's and 0's inside of a silicon chip somewhere. 1's and 0's are not going to "take over" anything. They are just information.