News for hackers. Stuff that matters.
Re:Cargo Cult AI by danielbln on Saturday August 05, 2023 @01:33PM (#37014437)
Technically it can do in-context learning (and really well, too), but that's not persisted into the network.
Re:Cargo Cult AI by kenjackson on Saturday August 05, 2023 @02:03PM (#37014764)
And that just seems like an engineering problem. Not something that is considered intractable.
Re:Cargo Cult AI by version_five on Saturday August 05, 2023 @03:39PM (#37015607)
It's easy to say that, but "surely it must be possible to connect an llm in such a way that it becomes intelligent" (tell me if I'm misinterpreting) is not a demonstration of anything. It's basically restating the view from the 50s that with computers having been invented, an intelligent computer is a short way off.
Re:Cargo Cult AI by dinvlad on Saturday August 05, 2023 @02:15PM (#37014880)
Learning != inference. Learning is development of generalizable knowledge, of which this is simply not, since it can’t extend beyond the short context window.