News for hackers. Stuff that matters.
Re:Simply explained: How does GPT work? by danenania on Thursday April 06, 2023 @07:00PM (#35475694)
Those aren't good analogies. An LLM isn't like a xerox machine or a tape recorder. Again, the answers to the bar exam it passed weren't in its training data. Nor was the code it wrote for me.

I'm using the common, colloquial definition of reasoning. I don't think we need an academic treatise to say that passing the bar exam (without copying the answers) or writing code for a novel task requires reasoning.

You're right that we don't fully understand how the LLM is doing this, but that doesn't mean it isn't happening.

Re:Simply explained: How does GPT work? by ttpphd on Friday April 07, 2023 @10:17AM (#35481816)
Thank you, yes, for saying I am right in saying that the evidence is lacking, which was precisely my original point.
Re:Simply explained: How does GPT work? by danenania on Friday April 07, 2023 @12:28PM (#35483494)
The evidence isn’t lacking :) We have lots of evidence. What we lack is a coherent theory that explains the evidence.