News for hackers. Stuff that matters.
Re:The space of minds by atq2119 on Sunday November 30, 2025 @12:57PM (#46098845)
> LLMs are humanity's "first contact" with non-animal intelligence.

I'd say corporations are also a form of non-animal intelligence, so it's not exactly first contact. In some ways, LLMs are less alien, in other ways they're more.

There is an alignment problem for both of them. Perhaps the lesson to be drawn from the older alien intelligence is that the most impactful aspect of alignment is how the AI's benefits for humanity are distributed and how they impact politics.

Re:The space of minds by ACCount37 on Sunday November 30, 2025 @02:09PM (#46099425)
I don't agree entirely, but I do think that "corporation" is a decent proxy of what you can expect from a moderately powerful AI.

It's not going to be "a smart human". It's closer to "an entire office tower worth of competence, capability and attention".

Unlike human corporations, an AI may not be plagued by all the "corporate rot" symptoms - degenerate corporate culture, office politics, CYA, self-interest and lack of fucks given at every level. Currently, those internal issues are what keeps many powerful corporations in check.

This makes existing corporations safer than they would otherwise be. If all of those inefficiencies were streamlined away? Oh boy.

Re:The space of minds by cgio on Sunday November 30, 2025 @04:54PM (#46100807)
These inefficiencies are akin to having some “wrong” weights in a huge model. Corporations also average over their individual contributions, positive or negative. And negative feedback loops may be individually detrimental but collectively optimising.
Re:The space of minds by ACCount37 on Monday December 01, 2025 @05:12PM (#46114028)
Not really.

Human flaws permeate the entire body of a corporation. The scale may average out some of it, but humans are not just randomly flawed - they're also systematically flawed on the top of it, and averaging does little to counter that.

And the "top end" of the corporation doesn't have enough averaging to mitigate even the random flaws. If someone in the C-suite makes the dumbest decisions ever, the entire system may suffer immense damage before it corrects - if it ever does.

Re:The space of minds by eikenberry on Sunday November 30, 2025 @02:32PM (#46099633)
I disagree. Corporations are a form of a collective intelligence, or group-think, which is decidedly biological or "animal", just like herding, flocking, hive-minds, etc.
Re:The space of minds by fulafel on Sunday November 30, 2025 @03:30PM (#46100111)
It could be like flocking if they were free to do what the members collectively want to do (without things like "maximize shareholder value").
Re:The space of minds by eikenberry on Monday December 01, 2025 @02:30PM (#46111933)
Couldn't the regulations just be viewed as environmental changes that the entities would need to adapt to?
Re:The space of minds by pixl97 on Sunday November 30, 2025 @01:52PM (#46099288)
Rob Miles: Think of AGI like a corporation?

https://www.youtube.com/watch?v=L5pUA3LsEaw

Re:The space of minds by 4er_transform on Sunday November 30, 2025 @07:20PM (#46101939)
Also: democracy, capitalism/the global economy, your HOA, a tribe, etc etc

Even a weather system is a kind of computational process and “intelligent” in a way