News for hackers. Stuff that matters.
Re:ChatGPT: It has no inner monologue or meta-cognition by chownie on Tuesday May 02, 2023 @02:29AM (#35784076)
I'm confused, "random chance" ...?

If you're giving it words from a sentence it is literally the baseline functionality of the text generator to choose the most likely next token, IE to recreate the most likely sentence from the words given.

This couldbe the least meaningfully revealing task I could possibly think of trying if I were trying to find some inner monologue, if gpt had to "think" on anything this would never be it.

Re:ChatGPT: It has no inner monologue or meta-cognition by og_kalu on Tuesday May 02, 2023 @02:50AM (#35784207)
Re:ChatGPT: It has no inner monologue or meta-cognition by chownie on Tuesday May 02, 2023 @07:56AM (#35786166)
The linked comment is a reiteration of the same thought in more words, it still makes the odd assertion against "random chance", you didn't even really give a reason except "it must be so"
Re:ChatGPT: It has no inner monologue or meta-cognition by og_kalu on Tuesday May 02, 2023 @09:36AM (#35787205)
Come to whatever conclusion you want lol. The point of the comment is that Blind probability is not enough. That should be clear enough.
Re:ChatGPT: It has no inner monologue or meta-cognition by danaris on Tuesday May 02, 2023 @09:57AM (#35787465)
The point of the responses to you is no one thinks it's blind probability. Constructing meaningful sentences out of words is literally the primary thing it's designed to do.

Chance simply doesn't enter into the equation to any notable extent.

Re:ChatGPT: It has no inner monologue or meta-cognition by og_kalu on Tuesday May 02, 2023 @10:05AM (#35787583)
Surface level probability doesn't work either.
Re:ChatGPT: It has no inner monologue or meta-cognition by throwaway675309 on Tuesday May 02, 2023 @02:55AM (#35784247)
Agreed, you could achieve the same success ratio by computing the stochastic probabilities of a well trained English corpus Markov model given those same words two decades ago.
Re:ChatGPT: It has no inner monologue or meta-cognition by og_kalu on Tuesday May 02, 2023 @02:58AM (#35784271)
No you actually couldn't lol. If you genuinely think this then you don't know what you're talking about.