OpenAI, Google and Anthropic Are Struggling to Build More Advanced AI

Re:OpenAI, Google and Anthropic Are Struggling to Build More... by Filligree on Thursday November 14, 2024 @01:48PM (#42139671)

Let me modify that a little, because humans can't do things outside their training set either.

A crucial element of AGI would be the ability to self-train on self-generated data, online. So it's not really AGI if there is a hard distinction between training and inference (though it may still be very capable), and it's not really AGI if it can't work its way through novel problems on its own.

The ability to immediately solve a problem it's never seen before is too high a bar, I think.

And yes, my definition still excludes a lot of humans in a lot of fields. That's a bullet I'm willing to bite.

[ Parent | on HN ]

Re:OpenAI, Google and Anthropic Are Struggling to Build More... by HarHarVeryFunny on Thursday November 14, 2024 @03:26PM (#42140807)

> Let me modify that a little, because humans can't do things outside their training set either.

That's not true. Humans can learn.

An LLM is just a tool. If it can't do what you want then too bad.

[ Parent | on HN ]

Re:OpenAI, Google and Anthropic Are Struggling to Build More... by Filligree on Friday November 15, 2024 @10:04AM (#42147539)

That’s… what I said, yes.

[ Parent | on HN ]

Re:OpenAI, Google and Anthropic Are Struggling to Build More... by lxgr on Thursday November 14, 2024 @02:15PM (#42140011)

Are you arguing that writing, doing math, going to the moon etc. were all in the "original training set" of humans in some way?

[ Parent | on HN ]

Re:OpenAI, Google and Anthropic Are Struggling to Build More... by layer8 on Thursday November 14, 2024 @02:31PM (#42140169)

Not in the original training set (GP is saying), but the necessary skills became part of the training set over time. In other words, human are fine with the training set being a changing moving target, whereas ML models are to a significant extent “stuck” with their original training set.

(That’s not to say that humans don’t tend to lose some of their flexibility over their individual lifetimes as well.)

[ Parent | on HN ]

Re:OpenAI, Google and Anthropic Are Struggling to Build More... by Jensson on Thursday November 14, 2024 @10:33PM (#42143746)

> (That’s not to say that humans don’t tend to lose some of their flexibility over their individual lifetimes as well.)

The lifetime is the context window, the model/training is the DNA. A human in the moment isn't general intelligent, but a human over his lifetime is, the first is so much easier to try to replicate though but that is a bad target since humans aren't born like that.

[ Parent | on HN ]