Re:I disagree with Geoff Hinton regarding "glorified autocom...
by brookst on Saturday November 18, 2023 @12:12PM
(#38321791)
So the externally provided metaprompt doesn’t establish a goal that generation works toward?
Re:I disagree with Geoff Hinton regarding "glorified autocom...
by TerrifiedMouse on Saturday November 18, 2023 @12:56PM
(#38322316)
I don’t think LLMs work towards anything. It just picks from a list of likely “next tokens” at random.
Re:I disagree with Geoff Hinton regarding "glorified autocom...
by brookst on Saturday November 18, 2023 @01:11PM
(#38322506)
“Likely” as defined by…?
Re:I disagree with Geoff Hinton regarding "glorified autocom...
by TerrifiedMouse on Saturday November 18, 2023 @03:26PM
(#38324000)
Statistics as defined by training data.
https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...
There is more to it. Specifically you are doing so to advance towards a specific goal. LLMs don't have goals. They just pick from a list of likely tokens - based on their training data - at random to generate the next token.