Re:I disagree with Geoff Hinton regarding "glorified autocom...
by user_named on Sunday November 19, 2023 @07:26AM
(#38332031)
Yes, you don't understand what I said. The model has no concept of true or false. It only has embeddings. If 'asked' a question it can see if that is consistent with its embeddings and probabilities or not. This is not a representation of the real world, of facts, but simply a product of its training.
Re:I disagree with Geoff Hinton regarding "glorified autocom...
by robbrown451 on Sunday November 19, 2023 @05:23PM
(#38339014)
"This is not a representation of the real world, of facts, but simply a product of its training."
Tell me how that doesn't apply to the human brain as well.
And I have no idea what you mean by saying that it has no concept of true or false. Even the simplest computer programs have a concept of true or false, that's kind of the simplest data type, a boolean. Large language models have a much more sophisticated concept of true and false that has a lot more nuance. That's really a pretty ridiculous thing to say.