News for hackers. Stuff that matters.

A comment on ChatGPT: It has no inner monologue or meta-cognition. Parent comment

Re:ChatGPT: It has no inner monologue or meta-cognition by chownie on Tuesday May 02, 2023 @08:18AM (#35786299)
Isn't the conclusion here just begging the question?

By the nature of number ranges there are infinitely many more wrong answers available to calculators performing addition and yet a simple ripple carry adder still promptly produces the correct output without lookahead, why this is compelling evidence?

Further, if it relied on internal state or lookahead why would it occasionally hallucinate appropriate tokens it wasn't provided?

[ Parent | on HN ]
Re:ChatGPT: It has no inner monologue or meta-cognition by og_kalu on Tuesday May 02, 2023 @09:39AM (#35787237)
Arithmetic has a number of always applicable steps. Unscrambling does not unless one of those steps is "think".

If you want to believe looking ahead is unecessary, be my guest lol.

Humans would occasionally "hallucinate" words in too. For whatever reason(and this is verified independently of any of this), LLMs also appear to "get distracted"

[ Parent | on HN ]