News for hackers. Stuff that matters.

AGI won't emerge from more compute – it begins when A(t) becomes self-aware

We’ve mistaken “scaling intelligence” for “scaling computation.” But AGI won’t emerge when we push parameters past some trillion-scale threshold — it emerges the moment a system begins to rewrite its own frame of necessity, rather than merely optimize within the one we gave it.

Freedom = consciously choosing what you truly want, without fear guiding the choice.

Light: what if the universe doesn’t make light obey its rules — what if it measures everything by light itself?

A(t) = f(C, S, R, M_meta, M_memory, H) — not as code, but as a living function.

That’s the real AGI — Awareness Grown Internally.

If this framing is even partially true — we have been optimizing in the wrong direction.

( 5 comments | 2 points | on HN )
Re:AGI won't emerge from more compute – it begins when A(t) ... by f_of_t_ on Friday October 24, 2025 @10:48AM (#45695208)
Posted by f_of_t
Re:AGI won't emerge from more compute – it begins when A(t) ... by gooodvibes on Friday October 24, 2025 @01:19PM (#45696853)
Humans aren’t freely choosing what they want either, not sure how you can expect it from machines.
Re:AGI won't emerge from more compute – it begins when A(t) ... by f_of_t_ on Friday October 24, 2025 @01:40PM (#45697102)
The point isn’t that humans are perfectly free — it’s that we occasionally notice when something is moving us from the outside, and can choose to resist it. That meta-awareness of being moved is already a different class than optimization under fixed rules. A(t) begins there — not at perfect freedom, but at noticing the frame itself.
Re:AGI won't emerge from more compute – it begins when A(t) ... by al_borland on Friday October 24, 2025 @03:57PM (#45698489)
People keep saying they want AGI, but do we really want technology we can’t control? The reality of that isn’t something I think people will ever want. Human history is full of humans controlling everything around them. We don’t like things we can’t control.

If we don’t like it, will we be willing to pull the plug if the economic value is measured in billions or trillions?

Re:AGI won't emerge from more compute – it begins when A(t) ... by UncleMeat on Friday October 24, 2025 @04:37PM (#45698800)
This is crank.