News for hackers. Stuff that matters.
Re:I disagree with Geoff Hinton regarding "glorified autocom... by TerrifiedMouse on Saturday November 18, 2023 @12:07PM (#38321726)
> when I speak am I just spitting out the next word that makes sense or is there more to it.

There is more to it. Specifically you are doing so to advance towards a specific goal. LLMs don't have goals. They just pick from a list of likely tokens - based on their training data - at random to generate the next token.

Re:I disagree with Geoff Hinton regarding "glorified autocom... by brookst on Saturday November 18, 2023 @12:12PM (#38321791)
So the externally provided metaprompt doesn’t establish a goal that generation works toward?
Re:I disagree with Geoff Hinton regarding "glorified autocom... by TerrifiedMouse on Saturday November 18, 2023 @12:56PM (#38322316)
I don’t think LLMs work towards anything. It just picks from a list of likely “next tokens” at random.
Re:I disagree with Geoff Hinton regarding "glorified autocom... by brookst on Saturday November 18, 2023 @01:11PM (#38322506)
“Likely” as defined by…?
Re:I disagree with Geoff Hinton regarding "glorified autocom... by TerrifiedMouse on Saturday November 18, 2023 @03:26PM (#38324000)