Re:"Hallucinating" AIs sound creative, but let's not celebra...
by nuancebydefault on Saturday October 14, 2023 @10:43AM
(#37880841)
> Human beings can act on the world as well as perceive it
Conceptually this is the same for LLMs.
Input/perceive -> human/LLM -> output/act. You might say the acting part for LLMs is not autonomous but that is only dependent on how much agency is given to LLMs. LLMs outputs are massively used, hence their outputs lead to actions.
> and humans have rich internal models of the world that get updated continously as a result of those rich two-way interactions.
What is different from LLMs: rich, continuous. I would argue these are quantative and qualitative traits that fall outside of what I meant with "conceptually".
Re:"Hallucinating" AIs sound creative, but let's not celebra...
by pdonis on Saturday October 14, 2023 @02:16PM
(#37882839)
> Conceptually this is the same for LLMs.
No, it isn't. LLMs don't look at the results of their actions and update a world model. Humans do.
Re:"Hallucinating" AIs sound creative, but let's not celebra...
by nuancebydefault on Saturday October 14, 2023 @04:41PM
(#37884081)
This is indeed a difference that I overlooked, there is limited feedback on LLMs output, other than a rater primitive survival model (models that aren't popular/correct/cheap/fast enough are not used anymore over time)
Wrong. Human beings can act on the world as well as perceive it, and humans have rich internal models of the world that get updated continously as a result of those rich two-way interactions.
> I would argue, human reasoning is conceptually not so much different from LLMs as one might think.
I would argue that this is either an incredible over-estimate of LLMs, or an incredibly impoverished view of humans.