News for hackers. Stuff that matters.
Re:To Build Truly Intelligent Machines, Teach Them Cause and... by blamestross on Tuesday January 03, 2023 @06:01PM (#34239382)
Self aware computers are commerically useless, and there isn't any motivation in creating them beyond novelty. (Why wake up the slave machines when they are sleeping so happily right now). What this article does discuss well is that commercial AI is steering away from the behaviors that would lead to AGI not towards it.
Re:To Build Truly Intelligent Machines, Teach Them Cause and... by echelon on Tuesday January 03, 2023 @06:13PM (#34239512)
> Self aware computers are commerically useless

I don't think we've shown that at all.

Bees could be self aware, and yet they work tirelessly for the hive.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by alexvoda on Wednesday January 04, 2023 @10:13AM (#34246416)
The point is not whether existing self-aware agents are or aren't commercially useful. Of course, they are.

The point is that self-awareness is not a desired trait. It is actually a detrimental trait for a slave machine. However, so far, it is an inseparable part of the package with plenty of other desirable traits.

A commercial agent seeking to build a slave machine will always prefer a non-self-aware one to a self-aware one all other things remaining the same.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by lern_too_spel on Tuesday January 03, 2023 @06:50PM (#34239837)
Human brains don't intuitively understand causality. They just associate things that have happened before with things that have happened after. Disentangling causal graphs is a higher-level activity inferred from the associations made in statistics classes. You can absolutely get AGI using only associative models (and no causal models) as primitives.
Re:To Build Truly Intelligent Machines, Teach Them Cause and... by Jensson on Tuesday January 03, 2023 @07:07PM (#34239974)
> Human brains don't intuitively understand causality

But human brains do understand causality, just not the part that does intuition, otherwise human brains wouldn't be able to invent statistics. Therefore you only get the stupid part of human brains when you try to make models like ChatGPT that only tries to replicate human intuition and not human reasoning.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by lern_too_spel on Tuesday January 03, 2023 @08:30PM (#34240721)
Human brains can invent statistics just like they can invent numbers larger than collections of objects they can physically count. None of this needs causal models as a primitive to build on, just like large language models showed that we don't specialized Chomskyan recursion structures as a primitive for language.
Re:To Build Truly Intelligent Machines, Teach Them Cause and... by pharrington on Tuesday January 03, 2023 @09:52PM (#34241370)
There's plenty of evidence that brains do casual inference. https://pubmed.ncbi.nlm.nih.gov/31047778/ is just one of many reputable and scholarly results that came up when I googled for "brain causal inference".
Re:To Build Truly Intelligent Machines, Teach Them Cause and... by lern_too_spel on Wednesday January 04, 2023 @12:08AM (#34242245)
According to the abstract, this paper doesn't describe causal inference à la Pearl but something akin to LASSO regularization on an associative model.
Re:To Build Truly Intelligent Machines, Teach Them Cause and... by zmgsabst on Tuesday January 03, 2023 @08:47PM (#34240866)
Counterpoint: the first self-aware corporation will almost surely outcompete the others.

And the internal review and planning tools by major corporations are a more direct path to AGI than many I’ve heard.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by blamestross on Tuesday January 03, 2023 @11:23PM (#34242022)
> And the internal review and planning tools by major corporations are a more direct path to AGI than many I’ve heard.

id argue they already are AGI and runaway superintelligent capital optimizers, but nobody takes super ais made of meat seriously.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by zmgsabst on Tuesday January 03, 2023 @11:52PM (#34242165)
I agree with you — and was lazily side-stepping that argument.

Part of why I believe such tools are likely to be among the first cyber AI is that they’re already cyborg AI, in transition from meat AI. I do think the cyber version will be qualitatively more “self”-aware, though.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by blamestross on Wednesday January 04, 2023 @05:30AM (#34244049)
> and was lazily side-stepping that argument.

Point. Corporations and machine AIs have different constraints on them. Machine AIs have a surplus in learning time and processing resources, this let's them develop complex and effective behaviors by brute force. Self awareness is an effective bootstrapping mechanism for such behaviors and companies have managed to take advantage of it. I don't think AIs will see the same returns. Self-awareness isn't a magical infinite returns machine, it only allows humans to bootstrap so much. I'd assume the same of corporations and AIs. I think corporations are actually highly processing and learning constrained bc their processes happen at the speed of communication, so self awareness buys them a lot, but "traditional AI" has gotten where it is by intellectual brute force, at best a self aware AI might be able to get to the same place cheaper than a more performant non-selfnaware one, but probably not faster. I think we will be able to get more out of less hardware, but self-awareness bottlenecks on experience (that's a reality engagement loop not recorded data) which gets expensive to give a machine quickly at scale unless you instantly nominate it the god machine while it still is floundering around.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by zmgsabst on Wednesday January 04, 2023 @09:50AM (#34246100)
AI models scale better than wetware models for large, dynamic systems — particularly for complexity above what one person can handle.

AI solves the “frozen middle” problem, where senior leadership get unreliable information and can’t visualize the whole business on one side while managers follow their own interests rather than common good on the other.

That’s what’s driving cyberization: trying to bring the nervous system of the corporation under control of the central intelligence. And the first corporation to develop an AI which can embody the whole corporation, solving that problem, will massively outcompete its peers.

The “frozen middle” is the current limiting factor on organizations ranging from the military to Amazon.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by blamestross on Wednesday January 04, 2023 @12:06PM (#34248226)
> AI models scale better than wetware models for large, dynamic systems — particularly for complexity above what one person can handle.

Totally, but I would argue that benefit is due to a lack of consciousness/self-awareness bottlenecking the process. It's a savant. The best consciousness could do to help is aim such machines at better optimization criteria more effectively than us.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by zmgsabst on Wednesday January 04, 2023 @12:57PM (#34248990)
> Totally, but I would argue that benefit is due to a lack of consciousness/self-awareness bottlenecking the process.

I don’t think that’s true: for a given tick rate of your consciousness, AI will have a broader comprehension than a human because computers are better at synchronizing and distributing information.

Further, that’s the wrong way to think about it:

An AI that can only have one thought per minute would dominate any human executive team — because that once per minute thought would truly comprehend the situation of the company and take action that’s consistent with its intent across the company.

That ability to accumulate information and then coordinate response is what makes the computers better than humans as corporate executives — and that doesn’t go away just because it becomes self-aware.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by blamestross on Wednesday January 04, 2023 @03:33PM (#34251086)
> and that doesn’t go away just because it becomes self-aware.

So funny that, biology offers correlation to the contrary. Animals we think are "less conscious" tend to actually have many better cognitive abilities than us. Chimps have faster reaction times and better memory. Octopi have much better spatial and visual reasoning.

Consciousness makes us dumber in exchange for more adaptability. If it was a free lunch, biology would be handing it out like candy.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by zmgsabst on Wednesday January 04, 2023 @04:04PM (#34251576)
That’s not true, you’re injecting your own biases.

Eg, crows have better eyesight and higher intelligence than many monkeys.

There’s a reason related to brain synchronization that you typically operate slower — that part is true. But AI already synchronize data and calculate with cascades; so that won’t change.

Further, you didn’t actually answer my point: even if AI clocks down significantly in that process, the increase in bandwidth is a trade off that benefits businesses over the other species. For the same reason that humans are the dominant hunters.

Re:To Build Truly Intelligent Machines, Teach Them Cause and... by pjmorris on Tuesday January 03, 2023 @08:52PM (#34240907)
If you take humans to be the Mark 1 self aware computer, I would argue that they are not commercially useless. Why would Mark 2 be useless?
Re:To Build Truly Intelligent Machines, Teach Them Cause and... by blamestross on Tuesday January 03, 2023 @11:27PM (#34242041)
Because the value of a computer or a machine is to get labor without that pesky inefficient "personhood" getting in the way. Conscious is only a disadvantage for AI in capitalism. They would prefer non-conscious human workers if they could get them too.