News for hackers. Stuff that matters.
Re:What Comes After AGI? by torben-friis on Friday November 20, 2026 @05:43AM (#50572844)
>We are treating AGI like is something that we can measure. We don't even know what intelligence really is let alone measure it.

Here's a nice test: Can an AI fully substitute you?

I don't mean replacing you at your job. I mean, if you take a human body and route its higher brain function to an AI, would it be able to perform convincingly?

I would say currently we're very far from such a scenario.

When I consider the option to buy a shirt, the problem is considered in a large amount of dimensions intuitively (is it warm enough, does it fit, does it clash with my wardrobe, will my girlfriend like it, will my friends laugh at me for wearing it, does it make me look older, is it a good price, are sales happening soon, is it annoying to clean, can I afford it, will carrying a bag with the purchase annoy me for the rest of the day).

Currently AI can offer good answers for any of those dimensions if explicitly asked, but it is pretty bad at the "intuitive creativity" of surfacing those points of consideration when relevant. It will at most chose a couple of criteria and fixate on them.

I think this ability, however it's defined, is a missing prerequisite for AGI. Without it, you can have something that outperforms humans at every individual task and still sucks in real world decision making.

Re:What Comes After AGI? by Jtarii on Friday November 20, 2026 @05:54AM (#50572938)
I don't think intuition about the things that a specific type of monkey cares about is a prerequisite for "AGI".
Re:What Comes After AGI? by danlitt on Friday November 20, 2026 @06:32AM (#50573252)
"a specific type of monkey" is a funny way of saying "the only generally intelligent thing we are aware of".
Re:What Comes After AGI? by thmoonbus on Friday November 20, 2026 @07:52AM (#50574005)
I mean we did create the technology and came up with the concept of intelligence, as we understand it (and defined the term AGI based on our concept of intelligence).

Why do people insist on talking about AI like it’s some supernatural, otherworldly creation? No matter how advanced it is, it’s still human technology.

Re:What Comes After AGI? by torben-friis on Friday November 20, 2026 @11:04AM (#50576823)
I don't think you understood the point at all.

Ask a model whether a human purchasing clothes would care about clothes fitting well, or the price, or the opinion of their romantic partner. The model will in all likelihood get the answer right. Familiarity with human preferences is not what's missing, which is hardly surprising considering an LLM is trained on human-made content.

What it lacks is the ability to notice and surface these non obvious constraints when relevant. This is fundamental to real world decision making.